Lead Data Engineer

• Design, build, and manage scalable data architectures using Databricks and Azure data technologies.
• Architect and implement modern data lakehouse solutions, ensuring seamless data integration, storage, and processing.
• Collaborate with cross-functional teams to gather and translate business requirements into effective technical designs.
• Ensure data quality and governance practices are implemented throughout the data lifecycle.
• Optimize data workflows for performance, reliability, and security using Azure Synapse, Data Factory, and Databricks.
• Develop and enforce best practices in data modeling, pipeline design, and storage architecture.
• Conduct regular assessments of data systems to identify and address performance bottlenecks or areas for improvement.

• 3+ years of hands-on experience with Databricks technology.
• Proven expertise in designing and managing scalable data architectures.
• Strong proficiency with Azure Synapse, Data Factory, and other Azure data technologies.
• Experience in data modeling, pipeline design, and storage architecture.
• Deep understanding of data quality and governance practices.
• Ability to collaborate with cross-functional teams and translate business requirements into technical designs.

• Familiarity with other modern data processing tools and technologies.
• Previous experience in a similar role working with large-scale data systems.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.