Epicareer Might not Working Properly
Learn More

Data Engineer

  • Full Time, onsite
  • Method3
  • Hybrid****candidates must be located within a 100 mile radius of Harrisburg, United States of America
Salary undisclosed

Apply on


Original
Simplified

We are looking for a Data Automation Engineer to play a crucial role in designing, building, and automating data architectures, pipelines, and business processes. This position merges the skills of a data architect, data engineer, and process automation engineer to create comprehensive data solutions that drive business transformation. The ideal candidate will have expertise in Data Lakehouse platforms like DataBricks or Microsoft Fabric, enterprise reporting tools such as Microsoft Power BI, and Microsoft automation technologies, including Power Platform, SharePoint, and Azure. Proficiency in scripting, data integration, process automation, and data governance is essential. This role involves collaborating closely with business stakeholders to develop customized solutions that streamline workflows, enhance data quality, and provide actionable insights.

Key Responsibilities:

  • End-to-End Data Architecture and Automation
  • Data Pipeline and Workflow Development
  • Data Quality, Cleansing, and Testing
  • Collaboration with Business SMEs and Stakeholders
  • Documentation and Process Standardization:
  • Performance Optimization and Continuous Improvement

Required Skills and Qualifications:

  • Experience:
    • Experience in data architecture, engineering, and process automation, with hands-on expertise in Microsoft technologies (Power Platform, Azure, SharePoint).
    • Proven track record of designing and implementing data architectures, both cloud-based (Azure, AWS) and on-premises, with strong knowledge of ETL/ELT processes.
    • Proficient in developing scripts (Python, PowerShell, SQL) for automation and data integration.
    • Extensive experience in data cleansing, validation, and testing, including managing test data sets and automated test scripts.
    • Experience working directly with business stakeholders to gather requirements and deliver tailored data automation solutions.
  • Technical Skills:
    • Advanced knowledge of Microsoft Azure services (e.g., DataBricks, Data Factory, Fabric, Synapse Analytics, Data Lake) and Power Platform (Power Automate, Power Apps, Power BI).
    • Strong SQL proficiency for database design, query optimization, and ETL development.
    • Expertise in Python, PowerShell, and other scripting languages for automation tasks.
    • Familiarity with cloud-based solutions (Azure, AWS, Google Cloud Platform), data lakes, and data warehouse architectures.
    • Experience with Microsoft Graph APIs and integration with Microsoft 365 services for automation and workflow enhancement.
    • Proficiency in version control (e.g., Git) and CI/CD pipelines for automating development and deployment workflows.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job