Data Engineer With Scala/Spark
Apply on
Availability Status
This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.
Job Title : Data Engineer With Scala/Spark
Location : Remote
Contract Type: C2C or W2
Job Description :
Need a senior engineer with 10+ years of experience.
Must be able to design, build and deploy data transformation and ETL jobs in Azure or AWS cloud.
Work with large scale datasets
Work with/use various external APIs to enhance data
Setup database tables for analytics users to consume the data collected by the Data Engineering team
Work with big data technologies to improve data availability and data quality in the cloud (Azure or AWS)
Skills Required:
- Strong technical experience in Scala and Spark for designing , creating and maintaining applications.
- Experience with Cloud Data Platforms like Databricks.
- Experience with Azure cloud (or similar cloud like AWS).
- Strong SQL skills with commensurate experience in a large database platform.
- Experience implementing ETL routines with 100M+ datasets in a performant and scalable manner
- Experience with relational database design (MySQL, Postgres etc)
- Experience in complete SDLC process and Agile Methodology
- Strong oral and written communication skills