Senior Databricks Data Engineer
Apply on
Availability Status
This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.
Job Title: Senior Databricks Data Engineer
Location of role: Greater St. Louis - Able to be in office, Clayton, Hybrid role. Good work/life balance.
Salary total comp base and bonus in the 150K to 160K area - Depending on experience DOE
Qualifications:
Summary:
This person must have solid ETL Databricks experience with full end-to-end programming.
Need to be able to do data standardization, aggregation, data quality, medallion architecture with strong knowledge of Python and SQL.
Someone who works with Delta Lake, Pyspark, Cluster optimization, streaming, workflows / pipelines, (DABS would be nice but not required).
Must be able to do both developing and maintaining of pipelines
- Bachelor's degree Computer Science, Information Technology or a related field
- At least 5 years of professional experience in ETL, BI, data integrations engineering.
- Hands-on experience with Databricks and AWS/Azure
- Hands-on experience designing and implementing modern data platforms and pipelines
- Experience with Python, PySpark, C#, or similar high-level language
- Experience with Microsoft SQL databases and SSIS development preferred
- Experience with development in public cloud, preferably in AWS
- Ability to perform complex data analysis and troubleshooting
Preferred Qualifications:
- Experience with IaaS Development: VS Code, Github, Terraform
- Hands-on experience designing and implementing modern data platforms and pipelines
Responsibilities
- This Senior Engineer will be developing and maintaining data pipelines for high impact areas. Emphasis on define, design, develop, unit test, and support ETL solutions to meet complicated critical business requirements.
- Please have experience with sensitive production incident resolution, performing code reviews, and pipeline testing.
- Troubleshooting and resolve data integration issues is essential, as is documentation and knowledge sharing as it relates modernizing data engineering practices.
Relocation - At this time, client will NOT relocate for this role
Company sponsorship - At this time, client will NOT sponsor for this role
Travel: This role may require 0% travel
Duration of role: Direct hire Role - Fulltime