Senior Data Engineer (Cloud)
Salary undisclosed
Apply on
Original
Simplified
Description
- The Senior Data Engineer will design, code, test, and analyze software programs and applications.
- This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle.
- This role will also analyze and amend software errors in a timely and accurate fashion and provide status reports where required.
- The position responsibilities outlined below are not all encompassing. Other duties, responsibilities, and qualifications may be required and/or assigned as necessary. Responsibilities:
- Work with Product team to determine requirements and propose approaches to address users' needs
- Analyze requirements to determine approach/proposed solution
- Thoroughly test solutions using relevant approaches and tools
- Conduct research into software-related issues and products
- Bring out-of-box thinking and solutions to address challenging issues
- Effectively prioritize and execute tasks in a fast-paced environment
- Work both independently and in a team-oriented, collaborative environment
- Flexible and adaptable to learning and understanding new technologies
- Highly self-motivated and directed
- Strong verbal and written communication skills
- Demonstrate integrity and maturity, and a constructive approach to challenges
- Demonstrate analytical and problem-solving skills, particularly those that apply to Data Warehouse and Big Data environments
- Open minded, solution oriented and a very good team player
- Hands on experience in developing Data Lake and Data Warehouse and Data Marts
- Experience in industry standard ETL/ELT tools
- Hands on experience with AWS cloud architecture and development using AWS resources like S3, Lambda, API Gateway, RDS, etc
- Proficiency in relational databases (Snowflake, Redshift, etc), database concepts and dimensional modeling
- Experience in data cleansing, data validation and data wrangling
- Proficiency in SQL and Scripting (Unix sell scripts, Python)
- Hands on experience in trouble shooting complex ETL and SQL problems
- Hands on experience in designing and building data pipelines in AWS cloud using S3, Lambda, API Gateway, RDS, Redshift, etc.
- Experience in data pipeline development using ETL tool, Informatica IICS
- Experience in scripting languages, Unix scripting and Python.
- 6+ years of experience within the field of application/platform engineering or related technical work including business intelligence, analytics.
- 4+ years of experience with AWS Senior Cloud Data Engineering, management, maintenance, or architecting, implementing best practices and industry standards.
- Experience with data warehousing platforms such as Snowflake, Redshift or similar.
- Strong knowledge and established experience with AWS services including but not limited to: S3, EC2, RDS, Lambda, Cloud Formation, Kinesis, Data Pipelines, EMR, Step Functions, VPC, IAM, and Security Groups.
- Experience with DB technologies (e.g., SQL, Python, PostgreSQL, AWS Aurora, AWS RDS, MongoDB, Redis).
- Experience with CI/CD tools, pipelines, and scripting for automation. (GitHub Actions, Jenkins, AWS Code Pipeline tools, Cloud formation and Terraform).
- High degree of knowledge in IAM Roles and Policies
- Strong knowledge configuring AWS cloud monitoring and alerts for cloud resource availability.
- Strong scripting experience using PowerShell and/or Python.
- High degree of knowledge in PaaS and SaaS application performance.
- Understand enterprise level application architecture diagrams and IT security requirements.
Similar Jobs