T
Azure HDInsight Support Engineer
Salary undisclosed
Apply on
Original
Simplified
Top 3 skills
1. Minimum 5+ years experience with HD Insights; Spark
2. Minimum 5+ years experience with Azure Fundamentals and Azure PAAS (desirable)
3. Minimum 5+ years experience with Excellent Verbal and written Comms.
Description:
Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks and/or HDInsights
Delivering and presenting proofs of concept to of key technology components to project stakeholders.
Developing scalable and re-usable frameworks for ingesting of geospatial data sets
Integrating the end to end data piple-line to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Working with event based / streaming technologies to ingest and process data
Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
Evaluating the performance and applicability of multiple tools against customer requirements
Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Skills:
Technical support, Troubleshooting, HDinsight, Azure, Azure PAAS
Top Skills Details:
Technical support,Troubleshooting,HDinsight,Azure,Azure PAAS
Additional Skills & Qualifications:
Candidate Requirements
Years of Experience Required: 5-10 overall years of experience in the field.
Degrees or certifications required: none
Disqualifiers: poor communication skills in the HSA.
Best vs. Average: The ideal resume would contain deep technical skills in a variety of technologies
Performance Indicators: Performance will be assessed based on quality of work and meeting deadlines.
Strong knowledge of Data Management principles
Experience in building ETL / data warehouse transformation processes
Direct experience of building data pipelines using HDInsights and Apache Spark (preferably Databricks).
Experience using geospatial frameworks on Apache Spark and associated design and development patterns
Microsoft Azure Big Data Architecture certification.
Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
Experience with Apache Kafka / Nifi for use with streaming data / event-based data
Experience Level:
Intermediate Level
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
1. Minimum 5+ years experience with HD Insights; Spark
2. Minimum 5+ years experience with Azure Fundamentals and Azure PAAS (desirable)
3. Minimum 5+ years experience with Excellent Verbal and written Comms.
Description:
Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks and/or HDInsights
Delivering and presenting proofs of concept to of key technology components to project stakeholders.
Developing scalable and re-usable frameworks for ingesting of geospatial data sets
Integrating the end to end data piple-line to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Working with event based / streaming technologies to ingest and process data
Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
Evaluating the performance and applicability of multiple tools against customer requirements
Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Skills:
Technical support, Troubleshooting, HDinsight, Azure, Azure PAAS
Top Skills Details:
Technical support,Troubleshooting,HDinsight,Azure,Azure PAAS
Additional Skills & Qualifications:
Candidate Requirements
Years of Experience Required: 5-10 overall years of experience in the field.
Degrees or certifications required: none
Disqualifiers: poor communication skills in the HSA.
Best vs. Average: The ideal resume would contain deep technical skills in a variety of technologies
Performance Indicators: Performance will be assessed based on quality of work and meeting deadlines.
Strong knowledge of Data Management principles
Experience in building ETL / data warehouse transformation processes
Direct experience of building data pipelines using HDInsights and Apache Spark (preferably Databricks).
Experience using geospatial frameworks on Apache Spark and associated design and development patterns
Microsoft Azure Big Data Architecture certification.
Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
Experience with Apache Kafka / Nifi for use with streaming data / event-based data
Experience Level:
Intermediate Level
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Similar Jobs