Google Cloud Platform Data Engineer
Apply on
Miracle Software Systems, Inc. is looking for the position of Google Cloud Platform Data Engineer in Dearborn, Michigan. Please go through the below job description and let me know your interest with your updated resume.
Requirement Details:
Job Title: Google Cloud Platform Data Engineer
Location: Dearborn, Michigan.
Duration: Full-time
Skills Required: Google Cloud Platform,SQL,Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc,
Description:
Experience Required: 12+ years
Work Status: Hybrid
"Position Description:
We re seeking an experienced Google Cloud Platform Data Engineer who can build cloud analytics platform to meet ever expanding business requirements with speed and quality using lean Agile practices. You will work on analyzing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and Analytics in the Google Cloud Platform (Google Cloud Platform). You will be responsible for designing the transformation and modernization on Google Cloud Platform, as well as landing data from source applications to Google Cloud Platform. Experience with large scale solution and operationalization of data warehouses, data lakes and analytics platforms on Google Cloud Platform or other cloud environment is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can demonstrate an ability to design right solutions with appropriate combination of Google Cloud Platform and 3rd party technologies for deploying on Google Cloud Platform. You will: Work in collaborative environment including pairing and mobbing with other cross-functional engineers Work on a small agile team to deliver working, tested software Work effectively with fellow data engineers, product owners, data champions and other technical experts Demonstrate technical knowledge/leadership skills and advocate for technical excellence Develop exceptional Analytics data products using streaming, batch ingestion patterns in the Google Cloud Platform with solid Datawarehouse principles Be the Subject Matter Expert in Data Engineering and Google Cloud Platform tool technologies
Skills Required:
- Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment. Implement methods for automation of all parts of the pipeline to minimize labor in development and production - Experience in analyzing complex data, organizing raw data and integrating massive datasets from multiple data sources to build subject areas and reusable data products - Experience in working with architects to evaluate and productionalize appropriate Google Cloud Platform tools for data ingestion, integration, presentation, and reporting - Experience in working with all stakeholders to formulate business problems as technical data requirement, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management This includes designing and deploying a pipeline with automated data lineage. Identify, develop, evaluate and summarize Proof of Concepts to prove out solutions. Test and compare competing solutions and report out a point of view on the best solution. Integration between Google Cloud Platform Data Catalog and Informatica EDC. Design and build production data engineering solutions to deliver pipeline patterns using Google Cloud Platform (Google Cloud Platform) services: BigQuery, DataFlow, Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer, Cloud SQL, Compute Engine, Cloud Functions, and App Engine.
Skills Preferred:
- Strong drive for results and ability to multi-task and work independently - Self-starter with proven innovation skills - Ability to communicate and work with cross-functional teams and all levels of management - Demonstrated commitment to quality and project timing - Demonstrated ability to document complex systems - Experience in creating and executing detailed test plans
Experience Required:
- In-depth understanding of Google s product technology (or other cloud platform) and underlying architectures - 5+ years of analytics application development experience required - 5+ years of SQL development experience - 3+ years of Cloud experience (Google Cloud Platform preferred) with solution designed and implemented at production scale - Experience working in Google Cloud Platform based Big Data deployments (Batch/Real-Time) leveraging Terraform, Big Query, Big Table, Google Cloud Storage, PubSub, Data Fusion, Dataflow, Dataproc, Cloud Build, Airflow, Cloud Composer etc. - 2 + years professional development experience in Java or Python, and Apache Beam - Experience developing with micro service architecture from container orchestration framework - Extracting, Loading, Transforming, cleaning, and validating data - Designing pipelines and architectures for data processing - 1+ year of designing and building Tekton pipelines
Experience Preferred:
- Experience in building solution architecture, provision infrastructure, secure and reliable data-centric services and application in Google Cloud Platform - Experience with DataPlex or Informatica EDC is preferred - Experience with development eco-system such as Git, Jenkins and CICD - Exceptional problem solving and communication skills - Experience in working with DBT/Dataform - Experience in working with Agile and Lean methodologies - Team player and attention to detail - Performance tuning experience
Education Required:
Bachelor s degree in computer science or related scientific field IT or related Associated topics: data architect, data center, data integrity, data manager, data management, data scientist, data warehousing, sql, sybase, Teradata
Education Preferred:
Google Cloud Platform Professional Data Engineer Certified Master s degree in computer science or related field 2+ years mentoring engineers In-depth software engineering knowledge
Additional Safety Training/Licensing/Personal Protection Requirements:
Additional Information:
***POSITION IS HYBRID BUT WILL CONSIDER REMOTE FOR THE RIGHT PERSON***"
Interested candidates can reach amishra1@miraclesoft.com (or) contact (two four eight) - (four one two) - (zero three five four).
About Miracle Software Systems, Inc.:
Miracle Software Systems, Inc , founded in 1994, is a Global Systems Integrator specializing in ERP/ BPM (EAI/SOA) / B2B / Digital Experience Technologies and is a Minority Certified Private Business headquartered in Novi, MI USA. Over the past twenty five years, Miracle has helped numerous large and mid-sized businesses transition their IT to a Service Oriented Architecture, with IT Transformation Initiatives, deploying SAP / Oracle ERP Systems. Miracle has a global presence on four continents with multiple Global Development Centers spanning across the USA, Canada and India. Today, Miracle s team includes 2600 IT Professionals with a projected targeted expansion to 3000 by the end of 2023.
Whether it is Internal Application to Application(A2A/EAI) Integration, Process Integration(BPM), or Business to Business Integration using EDI / Web Services, API Management, Machine to Machine (M2M) Communications, Internet of Things(IOT), Cloud Integration or Mobile Application Integration, Miracle is the Systems Integrator of Choice and the Thought Leader in this industry. Miracle has been and continues to be a leader in the niche space of Business Integration and SOA services over the past 21 Years with Premier Partnerships with companies such as SAP, IBM, Oracle and Microsoft.
Note: For more information, visit our official website:
