Apply on
Original
Simplified
Job Title: Sr. Databricks Advisory/SME
Location: Remote
Job Type: Contract
Job Overview:
The Databricks Advisory/SME will serve as a technical leader, helping clients maximize their use of the Databricks platform. The role requires deep expertise in data engineering, data analytics, and machine learning, as well as an understanding of how to leverage Databricks' unified platform for big data processing and AI initiatives. The SME will work closely with internal and external stakeholders to design, implement, and optimize Databricks-based solutions.
Key Responsibilities:
Technical Leadership:
- Provide expert advice on leveraging Databricks for big data processing, analytics, and AI/ML workloads.
- Guide the design and implementation of scalable data solutions on Databricks.
- Collaborate with data engineers, data scientists, and business analysts to build and optimize data pipelines.
Architecture & Design:
- Design and validate Databricks architectures to support high-performance and secure data solutions.
- Develop data integration, ETL, and ELT strategies using Databricks Delta Lake.
- Recommend best practices for data storage, processing, and management.
Implementation & Optimization:
- Lead the deployment and management of Databricks clusters, ensuring efficient resource utilization.
- Optimize performance for large-scale data pipelines and workloads.
- Ensure solutions adhere to security and compliance requirements, including data encryption, access control, and GDPR compliance.
Collaboration & Stakeholder Management:
- Act as the primary Databricks expert, working closely with both technical and business stakeholders.
- Provide technical mentorship and guidance to in-house teams and client partners.
- Support pre-sales and post-sales technical consulting, including demos and solution assessments.
Training & Enablement:
- Deliver hands-on training and workshops for internal teams and clients on using Databricks.
- Stay up-to-date with the latest Databricks features, updates, and industry trends.
- Assist clients in upskilling their data teams on Databricks technologies.
Required Skills & Qualifications:
Technical Expertise:
- Extensive experience with Databricks, Spark, and other big data frameworks (e.g., Hadoop).
- Proficient in programming languages such as Python, Scala, and SQL.
- Strong experience with cloud platforms (Azure, AWS, Google Cloud Platform) and data engineering tools.
- Deep understanding of Databricks Delta Lake, streaming data solutions, and advanced analytics.
- Data Engineering & Machine Learning:
- Hands-on experience with data engineering, including ETL/ELT processes and real-time data pipelines.
- Familiarity with machine learning frameworks (MLlib, TensorFlow, Scikit-learn) and model deployment on Databricks.
- Problem-Solving & Communication:
- Strong analytical skills to solve complex data problems and optimize performance.
- Ability to communicate effectively with both technical and non-technical stakeholders.
- Experience leading technical teams or projects in a consulting environment is a plus.
Preferred Certifications:
- Databricks Certified Data Engineer
- Databricks Certified Machine Learning Professional
- Azure/AWS/Google Cloud Platform Certifications
Educational Background:
- Bachelor s or Master s degree in Computer Science, Data Engineering, or a related field.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Similar Jobs