Databricks Engineer
Apply on
Title: Data Engineer (Databricks)
Duration: 6 months, contract to hire
Location: Preference for local to NE Ohio but open to remote
Client is looking for a Data Engineer sitting in their Data Platform and Architecture Team. This role will focus on the rollout and maturation of the Azure Databricks platform, Databricks is new to the organization and as of today just have critical mass data on the platform, goal to have all mass data on the platform in 2025 and start the automation process.
Databricks + Infrastructure Administration:
Manage Databricks clusters, including provisioning, scaling, and optimization.
Configure Databricks workspace settings, permissions, and access controls.
Monitor Databricks performance and troubleshoot issues.
Implement Databricks security best practices, including data encryption and access management.
Work with cloud infrastructure teams to provision and configure Databricks environments.
Optimize Databricks performance by tuning cluster configurations and network settings.
Manage Databricks backups and disaster recovery plans.
Technical Background-
Candidates need to have experience with Databricks, ideally Azure hosted but ok with AWS experience. Ideally would like to have someone with a Terraform background for library automation (not creating new scripts, just maintaining what s in place). Additional technologies include FiveTran, Elation, Databases (Oracle, DB2, SQL Server), Azure Networking, EntraID, PowerBI
Must Have
Databricks
Azure (OK with AWS with a willingness to learn Azure)
Highly Preferred
Terraform (Exposure, not creating new scripts but maintain)
Nice To Have/Willing to Learn
FinOps (Allocation, Cost Tracking, Budget Optimization, etc.)
FiveTran
PowerBI