Checking job availability...
Original
Simplified
We are looking for a proficient Senior BigData Engineer to join our team to work on exciting opportunities.
Essential Functions:
- Help support Data Replication Service (Spark jobs) and develop features/bug fixes.
- Help port Data Copy Service (DCS) features into DRS.
- Help support SparkCp (a library) in debugging and fixing issues encountered by DRS.
- Help support the CDH Migration Tool in debugging and fixing issues encountered by customers.
- Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportability.
- Perform onboarding tasks to help move customer data.
- Monitor and address user requests and issues as they arise.
Qualifications:
- 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms.
- Expertise in Spark and Java.
- Knowledge of Golang is highly desirable.
- Good understanding of containerization using Docker and Kubernetes.
- Understanding of version control like Git and CI/CD workflow.
- Understanding of Parquet/Avro/Hive/Iceberg.
- Well experienced in debugging and troubleshooting.
- Good Communication and excellent collaboration skils to interact with internal customers.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job We are looking for a proficient Senior BigData Engineer to join our team to work on exciting opportunities.
Essential Functions:
- Help support Data Replication Service (Spark jobs) and develop features/bug fixes.
- Help port Data Copy Service (DCS) features into DRS.
- Help support SparkCp (a library) in debugging and fixing issues encountered by DRS.
- Help support the CDH Migration Tool in debugging and fixing issues encountered by customers.
- Implement monitoring/alerting improvements to the 3 tools mentioned previously for better supportability.
- Perform onboarding tasks to help move customer data.
- Monitor and address user requests and issues as they arise.
Qualifications:
- 6+ years overall software development experience with at least 3+ years of experience in large scale data platforms.
- Expertise in Spark and Java.
- Knowledge of Golang is highly desirable.
- Good understanding of containerization using Docker and Kubernetes.
- Understanding of version control like Git and CI/CD workflow.
- Understanding of Parquet/Avro/Hive/Iceberg.
- Well experienced in debugging and troubleshooting.
- Good Communication and excellent collaboration skils to interact with internal customers.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job