data engineer with aws cloud, terraform and python - local to CO

data engineer with aws cloud, terraform and python

Greenwood Village, CO - Hybrid - 2 days onsite and 3 days remote

6+ months

+ years of experience as a Data Engineer with a strong focus on AWS cloud-based environments.
Experience w/ Terraform, SQL and Python is a must
Extensive experience with AWS Cloud services such as AWS Glue, AWS Lambda, Amazon S3, Amazon Redshift, Amazon EMR, and AWS Kinesis.
Knowledge of data warehousing and data lake concepts.
Experience with ETL tools and frameworks.
Understanding of data modeling and data architecture.
Bachelors degree required
Please make sure dates on resume are accurate (month/year)

Key Responsibilities
Data Integration:
- Design, develop, and maintain scalable data pipelines and ETL processes using AWS services like AWS Glue, AWS Lambda, Amazon S3, Amazon Redshift, and Amazon EMR.
- Collaborate with data architects and analysts to understand their data needs and requirements.
- Optimize data pipelines for performance, scalability, and cost-efficiency.
- Implement data quality and governance standards to ensure data integrity and accuracy.
- Develop and maintain data infrastructure, including data lakes, data warehouses, and data marts.
- Troubleshoot and resolve data-related issues.
- Define data product domains and boundaries to ensure data consistency and quality.
- Design data sharing mechanisms and APIs to enable data exchange between teams.
- Assist in migrating existing data warehouses to AWS, including planning, execution, and optimization.
- Collaborate with data engineers to design and implement data integration strategies to extract, transform, and load (ETL) data from various sources into the cloud data platform.
- Ensure that data models are compatible with data sources and target systems.
- Integrate data products with the broader data platform, including data lakes, data warehouses, and analytics tools.
- Stay up-to-date with the latest trends and technologies in data engineering.

Performance Optimization:
- Monitor and optimize data platform performance, including query execution, data loading, and storage utilization.
- Implement best practices for indexing, partitioning, and clustering to improve query performance.
- Identify and address performance bottlenecks.

Security and Governance:
- Implement robust security measures to protect sensitive data, including encryption, access controls, and data masking.
- Develop and enforce data governance policies to ensure data quality, consistency, and compliance with regulations.
- Implement data lineage and provenance to track data movement and transformations.

Technical Leadership:
- Provide technical guidance and mentorship to data engineers, analysts, and scientists.
- Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.

Required Skills and Experience
Bachelor's degree in Computer Science, Data Engineering, or a related field.
7+ years of experience as a Data Engineer with a strong focus on cloud-based environments.
Strong proficiency in Terraform, SQL and Python.
Extensive experience with AWS Cloud services such as AWS Glue, AWS Lambda, Amazon S3, Amazon Redshift, Amazon EMR, and AWS Kinesis.
Knowledge of data warehousing and data lake concepts.
Experience with ETL tools and frameworks.
Understanding of data modeling and data architecture.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Strong understanding of data warehousing concepts and best practices.
Strong analytical and problem-solving skills.
Excellent communication and interpersonal skills.
Knowledge of cloud-native technologies and serverless computing.

Desired Skills
Experience with data visualization tools (e.g., Quick Sight, Tableau, Power BI).
Experience with machine learning and artificial intelligence.
Certifications in AWS data architecture or cloud architecture.
Experience with event-driven architectures and serverless computing.
Knowledge of domain-driven design and microservices patterns.
Experience with data governance and data quality frameworks.
Certifications related to AWS or data engineering

Sateesh

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.