Lead Data Engineer
Job Title: Lead Data Engineer
Interview: Virtual
Job Duration: Long term contract
Job Location: Saint Louis, MO
Job Description:
We are seeking a hands-on Lead Data Engineer to lead a small team, oversee end-to-end data pipeline development, and drive technical conversations with stakeholders. The ideal candidate will bring deep expertise in big data technologies and take ownership of testing, validating, and deploying scalable data solutions in a production environment.
Responsibilities:
- Lead and mentor two junior engineers, including code reviews and technical guidance.
- Design, build, and maintain robust data pipelines.
- Manage CI/CD processes for data workflows.
- Interact with customers and upstream stakeholders to align data solutions with business needs.
- Drive proof-of-concept efforts to validate architecture, technology choices, and data workflows.
- Ensure production readiness of big data systems through thorough testing and validation.
Requirements:
- 5+ years of experience as a Senior Data Engineer; leadership experience is a strong plus.
- Proficiency with the Big Data ecosystem, particularly Spark and Scala.
- Hands-on experience with Apache Hive and SQL.
- Exposure to AWS is preferred, especially in migration or deployment scenarios.
Job Title: Lead Data Engineer
Interview: Virtual
Job Duration: Long term contract
Job Location: Saint Louis, MO
Job Description:
We are seeking a hands-on Lead Data Engineer to lead a small team, oversee end-to-end data pipeline development, and drive technical conversations with stakeholders. The ideal candidate will bring deep expertise in big data technologies and take ownership of testing, validating, and deploying scalable data solutions in a production environment.
Responsibilities:
- Lead and mentor two junior engineers, including code reviews and technical guidance.
- Design, build, and maintain robust data pipelines.
- Manage CI/CD processes for data workflows.
- Interact with customers and upstream stakeholders to align data solutions with business needs.
- Drive proof-of-concept efforts to validate architecture, technology choices, and data workflows.
- Ensure production readiness of big data systems through thorough testing and validation.
Requirements:
- 5+ years of experience as a Senior Data Engineer; leadership experience is a strong plus.
- Proficiency with the Big Data ecosystem, particularly Spark and Scala.
- Hands-on experience with Apache Hive and SQL.
- Exposure to AWS is preferred, especially in migration or deployment scenarios.