Epicareer Might not Working Properly
Learn More

Kafka Engineer - Software Engineer iV (W2 & C2C)

Salary undisclosed

Apply on

Availability Status

This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.


Original
Simplified

Responsibilities:

Develop, implement, and manage streaming data pipelines using Confluent Kafka and Apache Flink.
Collaborate with data engineering teams to integrate streaming solutions with existing data platforms such as AWS and Snowflake.
Design, build, and maintain real-time data pipelines and ensure high data quality, integrity, and reliability. Utilize Terraform to manage and automate code deployments on AWS or other cloud environments.
Develop and maintain CI/CD pipelines for deploying and managing Kafka clusters and related infrastructure.
Collaborate with development, DevOps, and data science teams to understand data needs and deliver optimal solutions.
Provide support and guidance on Kafka-related issues and best practices to other teams.
Stay updated with the latest Kafka and streaming technologies and provide recommendations for improvements.

Required Qualifications:

3+ years of experience in software development, with a strong focus on Apache Kafka and distributed systems.
2+ years of experience in Python (preferred) or Java for building Kafka applications
Proven experience with Confluent Kafka, including Kafka Connect, Schema Registry, Apache Flink and KSQL.
Experience with Infrastructure as Code (IaC) tools, particularly Terraform.
Hands-on experience with AWS services (e.g., EC2, S3, IAM, Lambda) and Snowflake.
Solid understanding of data integration, ETL processes, and data pipeline orchestration.
Experience with operational monitoring and performance optimization of streaming pipelines.
Ability to troubleshoot and resolve complex technical issues related to Kafka and its ecosystem.
Strong analytical and problem-solving skills, with attention to detail.
Excellent verbal and written communication skills.
Ability to work effectively in a team environment and collaborate with cross-functional teams.
Preferred Qualifications:

2+ years of experience working with Confluent Cloud and implementing Kafka-based solutions.
Experience with other data streaming tools and platforms.
Familiarity with DevOps tools and practices, including CI/CD, Docker, and Kubernetes.
Certification in AWS, Kafka, or related technologies.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job