AWS Data Engineer (Remote work) - only w2
Apply on
AWS Data Engineer (Remote work)
Duration: 12 Months +
Job Description
About the Role:
We're seeking a highly skilled AWS Data Engineer to join our team and play a pivotal role in designing, building, and maintaining our data infrastructure. As an AWS Data Engineer, you'll be responsible for developing and managing robust data pipelines, ensuring data quality, and optimizing performance.
Responsibilities:
Design, develop, and maintain AWS Data Lake resources, leveraging hands-on technical and engineering expertise.
Implement and manage AWS Data Migration Services (DMS) for efficient data transfer.
Configure and troubleshoot AWS Glue components, including catalog, ETL processes, and Hudi databases.
Develop ETL pipelines using Python or Scala to extract, load, and transform data effectively.
Create and manage Hudi tables, ensuring optimal performance and data integrity.
Develop and configure SQS queues and Event Bridge schedulers for asynchronous communication and event-driven processing.
Work with Redshift databases, including development, setup, configuration, and troubleshooting.
Manage AWS Aurora MySQL databases, including stored procedure development, read replication setup, and troubleshooting.
Monitor and optimize AWS resources for performance improvement and cost-efficiency.
Qualifications:
Proven experience as an AWS Data Engineer or a similar role.
Strong proficiency in Python and Scala programming languages.
In-depth knowledge of AWS services, including Data Lake, Glue, Hudi, SQS, Event Bridge, Redshift, and Aurora MySQL.
Experience with ETL processes and data warehousing concepts.
Excellent problem-solving and troubleshooting skills.
Ability to work independently and as part of a team.
Strong communication and documentation skills.
Preferred Qualifications:
Experience with cloud-native technologies and serverless architectures.
Knowledge of data modeling and data governance best practices.
Certifications related to AWS data engineering or cloud computing