Epicareer Might not Working Properly
Learn More

Data Engineer

  • Full Time, onsite
  • Miracle Software Systems, Inc.
  • On Site, United States of America
Salary undisclosed

Apply on

Availability Status

This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.


Original
Simplified

Miracle Software Systems is seeking a Data Engineer with strong expertise in Google Cloud Platform (Google Cloud Platform) and data engineering.

Requirement Details:

Position: Data Engineer

Duration: Full-time with Miracle Software Systems, Inc.

Location: Novi, MI, USA

Primary Skills: Google Cloud Platform, BigQuery, BigTable, SQL, Python

Position Description: Key Responsibilities: 1. Data Pipeline Development: Design, build, and maintain scalable and robust data pipelines on Google Cloud Platform using tools such as Apache Airflow, Cloud Composer, and Cloud Dataflow. Implement data integration solutions to ingest data from various sources, including cloud storage, and third-party APIs. 2. Data Warehousing: Develop and optimize data warehouse solutions using BigQuery and other Google Cloud Platform services. Ensure data accuracy, consistency, and security within the data warehouse environment. Monitor and troubleshoot data pipeline and warehouse issues to maintain system reliability. 3. Cloud Platform Expertise: Utilize Google Cloud Platform services such as Cloud Storage, Cloud Run, and Cloud Functions to build scalable and cost-effective data solutions. Implement best practices for cloud infrastructure management, including resource provisioning, monitoring, and cost optimization. 4. Collaboration and Communication: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions. Collaborate with cross-functional teams to design and implement data models, ETL processes, and reporting solutions. 5. Automation and Optimization: Develop automated workflows using Apache Airflow and Astronomer to streamline data processing and improve efficiency. Continuously optimize data pipelines for performance, scalability, and cost-effectiveness. 6. Documentation and Training: Create and maintain comprehensive documentation for data pipelines, data models, and infrastructure components. Provide training and support to team members and stakeholders on data engineering best practices and Google Cloud Platform services.
Skills Required: Technical Skills: Proficiency in data pipeline tools and frameworks such as Apache Airflow, Cloud Composer, and Cloud Dataflow. Strong knowledge of Google Cloud Platform services, including BigQuery, Cloud Storage, Cloud Run, and Cloud Functions. Experience with SQL, Python, and other programming languages commonly used in data engineering. Familiarity with data modeling, ETL processes, and data integration techniques. Soft Skills: Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Ability to work independently and as part of a team in a fast-paced, dynamic environment.
Experience Required: 5+ years in data warehouse and 2+ years in Google Cloud Platform
Education Required: Bachelors in Science
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job