Epicareer Might not Working Properly
Learn More

Data Engineer

Salary undisclosed

Checking job availability...

Original
Simplified

Job Title: Data Engineer

Location: Remote

Duration: 12+ Months

Skills:-

Mandatory skills

Spark, Scala, Hive

Responsibilities:-

  • Responsibilities: Design, develop, and maintain scalable data pipelines using Spark and Scala.
  • Implement ETL processes to transform and load data into Snowflake and other data warehouses.
  • Develop and optimize Hive queries for efficient data extraction and transformation.
  • Collaborate with data scientists and business analysts to ensure data quality and consistency.
  • Build and maintain data models and ETL processes to support business intelligence and reporting tools.
  • Monitor and troubleshoot data pipelines to ensure high availability and performance.
  • Implement Python scripts for data processing and automation tasks.
  • Stay up-to-date with the latest trends and technologies in data engineering and propose improvements. 5+ years of experience as a Data Engineer or similar role.
  • Proficiency in Spark, Scala, Hive, Python, and Snowflake. Strong understanding of ETL processes and data warehousing concepts.
  • Experience with SQL and NoSQL databases.

Educational Qualifications: -

  • Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
  • Technical certification in multiple technologies is desirable.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job