
Data Engineer
Salary undisclosed
Checking job availability...
Original
Simplified
Key Responsibilities:
- Develop and maintain ETL processes to support data ingestion, transformation, and integration.
- Work with various file formats (TXT, CSV, XML, JSON, YAML) to ensure seamless data processing.
- Implement and optimize ETL workflows using EasyMorph, Databricks, Azure Data Factory, Talend, and Apache Nifi.
- Write clean, efficient, and maintainable code using Python, C#, or Java.
- Ensure data quality, accuracy, and integrity across ETL pipelines.
- Collaborate with data engineers and analysts to define and refine ETL requirements.
- Troubleshoot and resolve ETL failures, ensuring minimal downtime and impact.
- Follow test-driven development (TDD) methodologies to improve reliability and maintainability.
- Maintain and document ETL processes, providing insights and recommendations for improvements.
Required Skills & Qualifications:
- Bachelor s degree in Computer Science, Software Engineering, Data Science, or a related technical field.
- 1-3 years of experience in ETL development or data engineering.
- Experience with ETL tools and frameworks (EasyMorph, Databricks, Azure Data Factory, Talend, Apache Nifi).
- Strong programming skills in Python, C#, or Java.
- Familiarity with structured and semi-structured data formats (TXT, CSV, XML, JSON, YAML).
- Detail-oriented with a strong focus on data quality and validation.
- Ability to quickly learn and adapt to complex systems and processes.
- Understanding of test-driven development (TDD) and automated testing practices.
- Problem-solving mindset with strong analytical and debugging skills.
- Excellent communication and collaboration skills to work with cross-functional teams.
- Prior experience with EasyMorph, Databricks, Azure Data Factory, Talend, or Apache Nifi is a plus, but not required.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Key Responsibilities:
- Develop and maintain ETL processes to support data ingestion, transformation, and integration.
- Work with various file formats (TXT, CSV, XML, JSON, YAML) to ensure seamless data processing.
- Implement and optimize ETL workflows using EasyMorph, Databricks, Azure Data Factory, Talend, and Apache Nifi.
- Write clean, efficient, and maintainable code using Python, C#, or Java.
- Ensure data quality, accuracy, and integrity across ETL pipelines.
- Collaborate with data engineers and analysts to define and refine ETL requirements.
- Troubleshoot and resolve ETL failures, ensuring minimal downtime and impact.
- Follow test-driven development (TDD) methodologies to improve reliability and maintainability.
- Maintain and document ETL processes, providing insights and recommendations for improvements.
Required Skills & Qualifications:
- Bachelor s degree in Computer Science, Software Engineering, Data Science, or a related technical field.
- 1-3 years of experience in ETL development or data engineering.
- Experience with ETL tools and frameworks (EasyMorph, Databricks, Azure Data Factory, Talend, Apache Nifi).
- Strong programming skills in Python, C#, or Java.
- Familiarity with structured and semi-structured data formats (TXT, CSV, XML, JSON, YAML).
- Detail-oriented with a strong focus on data quality and validation.
- Ability to quickly learn and adapt to complex systems and processes.
- Understanding of test-driven development (TDD) and automated testing practices.
- Problem-solving mindset with strong analytical and debugging skills.
- Excellent communication and collaboration skills to work with cross-functional teams.
- Prior experience with EasyMorph, Databricks, Azure Data Factory, Talend, or Apache Nifi is a plus, but not required.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job