Epicareer Might not Working Properly
Learn More

Lead Google Cloud Platform Data Engineer

Salary undisclosed

Checking job availability...

Original
Simplified

Position

Lead Google Cloud Platform Data Engineer

Location

Boston MA / Remote

Job Type

Contract.

Job Description

  • Build and operationalize cloud-based platform components.
  • Build production quality ingestion pipelines with automated quality checks to help enable the business to access all of our data sets in one place
  • Understand and assess the systems architecture currently in place and work with technical staff to recommend solutions to improve it.
  • Build automation, using Python modules and DAGS, to support our product development and data analytics initiatives
  • Achieve maximum uptime of our platform utilizing cloud technologies such as Kubernetes, Terraform, Docker, etc.
  • Resolve technical problems, identify Root Cause, and propose potential solutions.
  • Provide guidance to development teams.
  • Continually research current and emerging technologies and propose changes where needed.
  • Assess the business impact that certain technical choices have.
  • Participate in a collaborative, peer review based environment fostering new ideas via cross team guilds / specialty groups
  • Maintain comprehensive documentation around our processes / decision making

YOUR QUALIFICATIONS

  • Have experience with DevOps / Automation tools to help minimize operational overhead for our platform
  • Must be able to contribute to self-organizing teams with minimal supervision working within the Agile / Scrum project methodology
  • Bachelor's Degree in Computer science or related field
  • 5+ years of related information technology experience
  • 3+ years of strong experience building complex ETL pipelines with dependency management utilizing File Watchers, APIs, etc.
  • Airflow, Talend, etc.
  • 3+ years of strong experience directly related to Big Data technologies
  • Spark, Hive, Hadoop, Parquet, HDFS, Python, Scala, Data Lake, NoSQL
  • Industry recognized certifications (similar to below):
    • Google Cloud Platform Certified Data Engineer
    • Google Cloud Platform Certified Solutions Architect
    • AWS Solutions Architect
    • Spark Certified Developer
  • Demonstrated experience with the Scrum Agile methodology
  • Deep familiarity with PaaS services, containers, orchestrations specifically around Docker and Kubernetes.
  • Strong ability to learn new technologies in a short time.
  • Must possess well-developed verbal and written communication skills.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job