Epicareer Might not Working Properly
Learn More
S

Python Lead Data Engineer (12 - 15 years Experience)

Salary undisclosed

Apply on

Availability Status

This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.


Original
Simplified

Job Title: Python Lead Data Engineer

Location: Remote

Pay Rate : $70 - $80/hr C2C

Duration: 12 months contract

Note : Must be certified in AWS

Required Qualifications:

  • 8+ years of experience in data engineering, with a strong focus on AWS cloud services (SQS, S3, Lambda, Step Functions, EFS, OpenSearch).
  • Proven experience in leading data engineering teams and delivering large-scale, production-grade data solutions.
  • Expertise in API integrations and working with large-scale, real-time data pipelines.
  • Hands-on experience with PySpark for distributed data processing and parallelism in large-scale ingestion pipelines.
  • Advanced knowledge of AWS OpenSearch and its APIs for managing search indices.
  • Extensive experience with Terraform for automating and managing cloud infrastructure.
  • Strong understanding of data flow architectures, distributed systems, and document stores.
  • Experience with AWS SageMaker for deploying machine learning models and managing endpoints.
  • Proven track record of optimizing data pipelines for cost-efficiency, scalability, and performance.
  • Familiarity with AWS monitoring tools like CloudWatch to track and enhance pipeline performance.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job