A
Senior Data Engineer w/Azure
Salary undisclosed
Apply on
Original
Simplified
Job Description
Job Description
This is a Hybrid opportunity with 3-4 days a week onsite.
Primary Responsibilities:
Working on Azure Architecture, design, implementation and operationalization of large-scale data and analytics and warehousing solutions on Snowflake Cloud Data Warehouse.
Hands-on development experience with Snowflake features such as; Python; SQL, Tasks; Streams; Time travel; Zero Copy Snow SQL; Snow Pipe Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
Developing ETL pipelines in and out of data warehouse using combination of Data bricks, Python and SQL/Snow SQL.
Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
Provide production support for Data Warehouse issues such data load problems, transformation problems
Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
Understanding data pipelines and modern ways of automating data pipeline using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Basic Qualifications:
Minimum 8 years of hands on experience with productionized data ingestion and processing pipelines using Python, PySpark, Data bricks and SQL/Snow SQL.
Experience designing and implementing an operational production grade large-scale data solution on
Microsoft Azure Snowflake Data Warehouse experience highly desired.
Understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies desired.
Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.
Top Technical skills
Top skills: Snowflake architecture, SnowSQL (Strong background), data factory (ADF) need capital market experience (equity/fixed income space) Python outbound, inbound analysis and SQL part of it financial industry experience
Nice to haves understanding of CI/CD pipeline, Python, concepts of warehousing
Primary Responsibilities:
Working on Azure Architecture, design, implementation and operationalization of large-scale data and analytics and warehousing solutions on Snowflake Cloud Data Warehouse.
Hands-on development experience with Snowflake features such as; Python; SQL, Tasks; Streams; Time travel; Zero Copy Snow SQL; Snow Pipe Cloning; Optimizer; Metadata Manager; data sharing; and stored procedures.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Need to have working knowledge of MS Azure configuration items with respect to Snowflake.
Developing ETL pipelines in and out of data warehouse using combination of Data bricks, Python and SQL/Snow SQL.
Developing scripts UNIX, Python etc. to Extract, Load and Transform data, as well as other utility functions.
Provide production support for Data Warehouse issues such data load problems, transformation problems
Translate mapping specifications to data transformation design and development strategies and code, incorporating standards and best practices for optimal execution.
Understanding data pipelines and modern ways of automating data pipeline using cloud based testing and clearly document implementations, so others can easily understand the requirements, implementation, and test conditions.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Basic Qualifications:
Minimum 8 years of hands on experience with productionized data ingestion and processing pipelines using Python, PySpark, Data bricks and SQL/Snow SQL.
Experience designing and implementing an operational production grade large-scale data solution on
Microsoft Azure Snowflake Data Warehouse experience highly desired.
Understanding of Snowflake Internals and integration of Snowflake with other data processing and reporting technologies desired.
Excellent presentation and communication skills, both written and verbal, ability to problem solve and design in an environment with unclear requirements.
Top Technical skills
Top skills: Snowflake architecture, SnowSQL (Strong background), data factory (ADF) need capital market experience (equity/fixed income space) Python outbound, inbound analysis and SQL part of it financial industry experience
Nice to haves understanding of CI/CD pipeline, Python, concepts of warehousing
Powered by JazzHR
9g2C5pXXoU
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Similar Jobs
