Epicareer Might not Working Properly
Learn More

Data Engineer

  • Full Time, onsite
  • IO Datasphere
  • Hybrid2 days/week on-site - 3 days/week remote, United States of America
Salary undisclosed

Apply on


Original
Simplified

IO Datasphere, Inc. has been providing project management, software development and IT staff augmentation services to our clients in the Midwest and throughout the U.S. since 1996. We are an approved vendor on contract to provide software development and IT staff augmentation services for the States of Illinois, Michigan, Minnesota, Iowa, and Wisconsin. We also provide these services to businesses, as well as local and county governments, in the Midwest and nationwide.

Our client is undergoing several technical and process/operational procedures modernization efforts. These modernization efforts include moving applications and infrastructure as code from on premise SQL servers to Microsoft Azure cloud hosting and web services. This process will include re-engineering web applications (.NET, JAVA) and SQL databases to take advantage of the Azure cloud infrastructure and native web services.

Modernization efforts also include refinement, streamlining, automation, and improving dev ops procedures (building a CI/CD pipeline, automating dev ops procedures, migrating from subversion to GitHub enterprise, and improving and adopting industry best practices for modern web application coding and design patterns and practices), automation of QA and test processes and procedures, writing test cases, scenarios, and scripts, test execution, test results, and adoption of new QA tools to increase QA process improvements and efficiencies including automation of testing suites (regression, etc.).

Tasks:
  • Contribute towards the architecture and build/maintain infrastructure using Cloud computing technology
  • Build and maintain scheduling/workflow orchestration applications
  • Build containerized applications with microservices architecture
  • Establish continuous integration and continuous delivery pipeline
  • Performance tuning of data pipelines
  • Monitor data pipelines for accuracy, missing data, enhancements, changes, and billing volumes to ensure all data is captured and processed accurately and when needed
  • Reconcile data issues and alerts between various systems, finding opportunities to innovate and drive improvements.
  • Provide knowledge transfer

Location: St Paul, MN (Hybrid)

Contract: 1+ years

Skills Required:

5 years - Experience developing applications for one or more of the following technology stacks:

  • Azure Data Factory / Azure Data Lake/ Azure Databricks/ Azure Fabric/ Azure Synapse
  • Microsoft Purview
  • Azure Cloud Experience
  • Practical experience with EDW (Enterprise Data Warehouse)
  • Proficiency in coding with PowerShell, Python
  • RESTful API s
  • NoSQL database like Cassandra etc.
  • MS SQL Server / SQL/T-SQL / Azure SQL Managed Instance
  • Shell Scripting
  • Microsoft Power BI for data analysis and reporting
  • Azure Pipelines

*** Rate depends on experience

*** Candidates authorized to work in the US are encouraged to apply. We are not sponsoring H1B candidates at this time.

*** Companies submitting candidates should only submit direct W2 employees for this position.

Please submit your resume by using the "URL" below

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job