Epicareer Might not Working Properly
Learn More
E

Data Engineer

Salary undisclosed

Apply on


Original
Simplified
Junior Data Engineer Remote Consulting Opportunity
The requirements are hands-on coding in Scala for ETL pipelines and building APIs. Must have experience in an Azure environment.
Context:
  • We have our data lake / platform setup
  • NH has tons of raw / unaltered data we receive on a regular basis that makes it's way into the data lake
  • Many of the data sources are about the same content (e.g. Centrum might receive medical claim information from over a dozen different insurance companies), but each source sends us the data in their own bespoke format
  • We're working on an initiative to have all of this data end up in a standard set of database tables (i.e. data normalization) (e.g. take 12x medical claim spreadsheets/csvs that come on a regular basis and produce a single list of ALL claims

Role Specifications

Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and T-SQL.
Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores.
Participate in building and owning a culture of DevOps and Quality Assurance.
Continuously document your code, framework standards, and team processes.
Build and support Data Ingestion frameworks deployed in Azure.
The work / skills:
  • Overall we're looking for contracting support that would be somewhere between a skilled analyst / junior data engineer.
  • The job would be:
    • input:
      • a document that specifies how the source file format should be manipulated to match our standard format
      • a sample source file
      • a template for how the normalization code/configuration should be setup
    • output:
      • a normalization configuration for a given source file format
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job