Epicareer Might not Working Properly
Learn More

Lead Big Data Engineer (Google Cloud Platform Cloud)

Salary undisclosed

Apply on


Original
Simplified

Job title: Lead Big Data Engineer (Google Cloud Platform Cloud)

Location: Irving, TX

Duration: Long-term

Job Description:

  • 10+ years of experience in designing and building data pipelines in large-scale distributed systems.
  • Lead the design, development, and maintenance of scalable batch and real-time data processing pipelines.
  • Proficiency with Google Cloud Platform (Google Cloud Platform) and tools such as BigQuery, Dataflow, Pub/Sub, GCS.
  • Strong experience with the Hadoop Big Data Ecosystem: HDFS, Hive, Pig, HBase, YARN, and others.
  • Proficiency in Python and Scala for data engineering and scripting.
  • In-depth knowledge of SQL for data manipulation, transformation, and analysis.
  • Experience building both batch and real-time streaming data pipelines
  • Solid understanding of Hadoop fundamental concepts
  • Strong familiarity with CI/CD pipelines
  • Excellent problem-solving skills with an ability to troubleshoot complex data systems and performance bottlenecks.
  • Proven ability to lead and mentor teams of engineers, driving the development of cutting-edge data solutions.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job