Epicareer Might not Working Properly
Learn More

Data Engineer - Data Cloud Migration

Salary undisclosed

Apply on


Original
Simplified
Overview

The Data Engineer will play a crucial role in advancing the CDC Foundation's mission by designing, building, and maintaining data infrastructure for a public health organization. This role is aligned to the Workforce Acceleration Initiative (WAI). WAI is a federally funded CDC Foundation program with the goal of helping the nation s public health agencies by providing them with the technology and data experts they need to accelerate their information system improvements.

Working within California Department of Public Health (CDPH), Center for Infectious Diseases Informatics Branch (CID), the Data Engineer will deliver a transition plan and architecture needed for migrating portions of the Integrated Infectious Disease Data Warehouse (I2D2) infrastructure from one cloud-based platform to another. The Data Engineer will collaborate with data content experts, analysts, informatics specialists, warehouse architects, IT staff and other organization staff to design and implement proposed solutions and architectures that meet the needs of the public health agency.

The Data Engineer will be hired by the CDC Foundation and assigned to the California Department of Public Health, Center for Infectious Diseases Informatics Branch. This position is eligible for a fully remote work arrangement for U.S. based candidates.

Responsibilities

  • Learn and assess the current cloud- based I2D2 infrastructure and functionalities.
  • Understand and assess current ETL processes to ensure the quality, accuracy, completeness, and consistency of data.
  • Collaborate with cross-functional teams to understand which I2D2 functions and business needs are supported by CDPH s Databricks instance.
  • Collaborate with informatics specialists, enterprise architects, and other IT staff to understand data needs and requirements and ensure that the proposed data infrastructure supports the organization's security and privacy standards.
  • Partner with ITSD, IB, CalREDIE Branch, and CalCONNECT Branch to outline a comprehensive transition plan that meets the needs of all teams without sacrificing necessary functionality.
  • Develop the foundational framework for establishing a Center-wide data lake within the databricks platform to optimize data pipelines, infrastructure, and workflows for performance and scalability.
  • Identifying specific deliverables and expectations for the transition by scheduled dates and timelines.
  • Knowledgeable about industry trends, best practices, and emerging technologies in data engineering, and incorporating the trends into the organization's data infrastructure.
  • Provide technical guidance to other staff.
  • Communicate effectively with partners at all levels of the organization to gather requirements, provide updates, and present findings.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
  • Minimum 5 years of relevant professional experience
  • Proficiency in programming languages commonly used in data engineering, such as Python, Java, Scala, SQL, or R. Candidate should be able to implement data automations within existing frameworks as opposed to writing one off scripts.
  • Experience with Microsoft Azure products.
  • Strong understanding and experience with cloud-based warehouses/data lakes including Snowflake and Databricks.
  • Experience regarding engineering best practices such as source control, automated testing, continuous integration and deployment, and quality checks.
  • Knowledge of data warehousing concepts and tools.
  • Experience with cloud computing platforms.
  • Expertise in data modeling, ETL (Extract, Transform, Load) processes, and data integration techniques.
  • Familiarity with agile development methodologies, software design patterns, and best practices.
  • Strong analytical thinking and problem-solving abilities.
  • Excellent verbal and written communication skills, including the ability to convey technical concepts to non-technical partners effectively.
  • Flexibility to adapt to evolving project requirements and priorities.
  • Outstanding interpersonal and teamwork skills; and the ability to develop productive working relationships with colleagues and partners.
  • Experience working in a virtual environment with remote partners and teams
  • Proficiency in Microsoft Office.

Job Highlights

  • Location: Remote, must be based in the United States
  • Salary Range: $103,500-$143,500 per year, plus benefits. Individual salary offers will be based on experience and qualifications unique to each candidate.
  • Position Type: Grant funded, limited-term opportunity
  • Position End Date: June 30, 2025

Special Notes

This role is involved in a dynamic public health program. As such, roles and responsibilities are subject to change as situations evolve. Roles and responsibilities listed above may be expanded upon or updated to match priorities and needs, once written approval is received by the CDC Foundation in order to best support the public health programming.
All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, national origin, age, mental or physical disabilities, veteran status, and all other characteristics protected by law.
We comply with all applicable laws including E.O. 11246 and the Vietnam Era Readjustment Assistance Act of 1974 governing employment practices and do not discriminate on the basis of any unlawful criteria in accordance with 41 C.F.R. 60-300.5(a)(12) and 60-741.5(a)(7). As a federal government contractor, we take affirmative action on behalf of protected veterans.
The CDC Foundation is a smoke-free environment.
Relocation expenses are not included.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job