Data Engineer Manager
Salary undisclosed
Apply on
Original
Simplified
Data Engineer Manager
Remote
- Experience leading team of data engineers & architects in large scale & complex big data solutions
Expertise in developing architecture blueprints for various design patterns - batch, real time and micro batches.
Extensive experience in designing and implementing scalable data solutions using AWS services like MWAA and Lambda, RDS, ECS, EKS (7+ years).
Proficient in Databricks using pyspark, unity catalog, SQL Warehouse (6+ years) for optimizing data pipelines, ensuring high performance, and managing large-scale data processing.
Proficient in Snowflake (5+ years) for optimizing queries, schemas, and security layers.
Deep expertise in FinOps best practices in AWS, Databricks, and Snowflake to build cost effective data products and solution
Adept at developing and enforcing data governance policies and best practices to ensure data quality and compliance.
Skilled in deployment patterns and proficient with CI/CD tools, specifically CDK, CloudFormation, and Terraform.
Knowledge of using AppSecOps tools and best practices
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Similar Jobs