Kafka Lead Developer

On-Site

Client is CVS

C2H Kafka resource in Richardson, TX or Buffalo Grove, IL (Must sit onsite 2-3 days / wk)

Skills set:

50% hands on dev / 50% lead

- oversight of other developers / helping through issues / providing updates in stakeholder meetings

<> Administration of Confluent Kafka infrastructure</><> Kafka brokers, Producer, Consumers, zookeepers, Kafka connect, schema registry, KsqlDB, Kafka streams.</><> Monitoring and setup using Prometheus, Grafana and confluent control Centre</><> Scripting using Shell and Python</><> Infrastructure as Code- Terraform</><> CI/CD using Jenkins</><> Knowledge on Google Cloud Platform/AWS/Azure Cloud</><> Managed/Custom Kafka connectors configuration</><> Kafka development experience with Microservices/java/j2ee frameworks.</>

Roles and responsibilities:

<> Leading and Architecting Confluent Kafka application</><> Creating Kafka topics and providing required access to the Producer Application to publish messages to the Kafka topic.</><> Providing appropriate access to the consumer group to consumer messages from Kafka topic for Consumer Application.</><> Diagnosing, Troubleshooting, and solving Kafka issues and maintaining the documentation for the same.</><> Developing middleware integration solution for enrichment or transformation</><> Deploying Source and Sink connectors on self-managed Virtual Machines (VM) based on the client s needs</><> Build data pipelines with Kafka connect/connectors to deploy and support Kafka Data stream processing. </><> Setup monitoring tool Prometheus, Grafana and confluent control Centre</><> Configure Grafana dashboard to monitor Confluent Kafka cluster and providing access to the requested users.</><> Setup alerts for Kafka Consumer Lags and other issues.</><> Responsible for implementation and ongoing administration of Confluent Kafka infrastructure.</>

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.