Apply on
Availability Status
This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.
Data Architect CTH / Direct-Hire REMOTE / Work From Home
Full Time
The role is a combination of design/implementation and consulting with hands-on experience. It will require one to envision, design, and implement the technical solution working with customer and internal technical team. Must have been involved in this role, where she/he has led the design and/or implementation of several complex data-oriented solutions on Hadoop Big Data Platform. Experience working with customer Business/IT team. Should be able to speak confidently throughout the conversation. The candidate is expected to play developer role who can interact with the customer, work with teams (local or remote) and lead the technical or business discussions in key meetings.
Skills & Experience
- Mandatory to have End-To-End experience working in a Databricks Data environment (Dev, QA and Prod) with large data sets (Petabytes)
- Must have worked on several projects in the Big Data / Hadoop space; Comfortable with the broader Databricks ecosystems
- Hands-on with experience with - Spark, Databricks & SQL; Good in Java / Python, PySpark/Spark language
- Experience working on Apache Spark, creating data processing jobs and running them on Databricks
- Experience with Python and deployments for data sourcing and loads into ADLS (Azure Data Lake)
- Very comfortable with SQL; Knowledge of Kafka would be value add; Basics of Unix commands
- Secondary Skills / Good To have Experience working with Azure Data Services (Big Plus)
- Soft skills/other skills Good communication skills and Positive attitude
- BE/BS /MS / MCA degree in Computer Science / IT / IS or relevant