Epicareer Might not Working Properly
Learn More

AWS Data Engineer

Salary undisclosed

Apply on

Availability Status

This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.


Original
Simplified

Job Overview:

We are seeking an experienced AWS Data Engineer to join our team and lead the design, development, and management of data integration processes. This role is crucial for ensuring seamless data flow and accessibility across our organization. As an AWS Data Engineer, you will work on integrating data from various sources, transforming it to meet business needs, and loading it into data warehouses or data lakes. Your efforts will directly support our data-driven decision-making processes.

Key Responsibilities:

  • Develop and Maintain Data Integration Solutions:
    Design and implement data integration workflows using AWS Glue, EMR, Lambda, and Redshift. Utilize PySpark, Apache Spark, and Python for processing large datasets. Ensure accurate and efficient ETL (Extract, Transform, Load) operations.

  • Ensure Data Quality and Integrity:
    Validate and cleanse data to maintain high quality. Implement monitoring, validation, and error-handling mechanisms within data pipelines to ensure data integrity.

  • Optimize Data Integration Processes:
    Enhance performance and scalability of data workflows to meet SLAs and cost-efficiency on AWS cloud infrastructure. Identify and resolve performance bottlenecks, and optimize queries and data processing for improved Redshift performance. Continuously review and refine integration processes.

  • Support Business Intelligence and Analytics:
    Translate business requirements into technical specifications and data pipelines. Ensure timely availability of integrated data for business intelligence and analytics. Collaborate with data analysts and stakeholders to fulfill data requirements.

  • Maintain Documentation and Compliance:
    Document data integration processes, workflows, and technical/system specifications. Ensure compliance with data governance policies, industry standards, and regulatory requirements.

Position Success Criteria:

  • Bachelor s degree in Computer Science, Information Technology, or a related field (Master s degree preferred).
  • 7-10+ years of experience in data engineering, database design, and ETL processes.
  • 5+ years of programming experience with PySpark and Python.
  • 5+ years of experience with AWS tools and technologies, including S3, EMR, Glue, Athena, RedShift, Postgres, RDS, Lambda.
  • 3+ years of experience working with databases, data marts, or data warehouses.
  • Proven expertise in ETL development, system integration, and CI/CD implementation.
  • Strong understanding of data security, privacy, and compliance.
  • Excellent problem-solving and communication skills.
  • Ability to effectively collaborate with multi-functional teams.
  • Experience with agile development processes, including sprint planning, stand-ups, and retrospectives.
  • Experience mentoring junior developers and a commitment to continuous learning and best practices in data engineering.

Apply Now to join our team and play a pivotal role in our data integration efforts!

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job