AWS Databricks Architect
Apply on
Position Overview:
The AWS Databricks Solution Architect/Lead will be responsible for designing, implementing, and optimizing data solutions using AWS and Databricks platforms. This role requires a deep understanding of cloud architecture, data engineering, and analytics to deliver scalable, high-performance solutions. The ideal candidate will have a proven track record of successful project leadership, technical expertise, and the ability to translate complex business requirements into effective technical solutions.
Key Responsibilities:
Architecting Solutions: Design and implement scalable, reliable, and high-performance data solutions on AWS using Databricks, ensuring alignment with business objectives and technical requirements.
Technical Leadership: Lead and mentor a team of data engineers, analysts, and architects. Provide guidance on best practices, architectural decisions, and the use of Databricks and AWS services.
Business Engagement: Collaborate with stakeholders to understand their data needs and business goals. Translate these needs into technical specifications and solutions.
Solution Design: Develop end-to-end data pipelines, data warehousing, and analytics solutions leveraging Databricks and AWS services such as S3, Redshift, Glue, and Lambda.
Documentation: Create and maintain detailed architectural diagrams, design documents, and implementation plans. Ensure comprehensive documentation of solutions and processes.
Collaboration: Work closely with cross-functional teams including data scientists, business analysts, and developers to ensure seamless integration of data solutions.
Qualifications:
Experience: 7+ years of experience in data engineering, cloud architecture, or related fields with a focus on AWS and Databricks. Proven track record of successful project delivery and technical leadership.
Technical Skills:
In-depth knowledge of AWS services, including but not limited to S3, EC2, RDS, Redshift, Glue, and Lambda.
Extensive experience with Databricks, including Spark SQL, MLlib, and Delta Lake. Strong understanding of data modeling, ETL processes, and data warehousing concepts.
Proficiency in programming languages such as Python, Scala, or SQL. Certifications: AWS Certified Solutions Architect (Associate or Professional) and Databricks certifications are highly desirable.
Communication: Excellent verbal and written communication skills with the ability to convey complex technical concepts to non-technical stakeholders.
Problem-Solving: Strong analytical and problem-solving skills with a creative and innovative approach to tackling challenges.
Leadership: Proven experience leading teams and projects, with a strong ability to mentor and guide junior team members.
Education:
Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.