Epicareer Might not Working Properly
Learn More

Senior Data Engineer (Cloud)

Salary undisclosed

Apply on


Original
Simplified
Description

  • The Senior Data Engineer will design, code, test, and analyze software programs and applications.
  • This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle.
  • This role will also analyze and amend software errors in a timely and accurate fashion and provide status reports where required.
  • The position responsibilities outlined below are not all encompassing. Other duties, responsibilities, and qualifications may be required and/or assigned as necessary. Responsibilities:
  • Work with Product team to determine requirements and propose approaches to address users' needs
  • Analyze requirements to determine approach/proposed solution

Design and Build Solutions using relevant programming languages

  • Thoroughly test solutions using relevant approaches and tools
  • Conduct research into software-related issues and products
  • Bring out-of-box thinking and solutions to address challenging issues
  • Effectively prioritize and execute tasks in a fast-paced environment
  • Work both independently and in a team-oriented, collaborative environment
  • Flexible and adaptable to learning and understanding new technologies
  • Highly self-motivated and directed

Experience and Skills: Must have skills:

  • Strong verbal and written communication skills
  • Demonstrate integrity and maturity, and a constructive approach to challenges
  • Demonstrate analytical and problem-solving skills, particularly those that apply to Data Warehouse and Big Data environments
  • Open minded, solution oriented and a very good team player
  • Hands on experience in developing Data Lake and Data Warehouse and Data Marts
  • Experience in industry standard ETL/ELT tools
  • Hands on experience with AWS cloud architecture and development using AWS resources like S3, Lambda, API Gateway, RDS, etc
  • Proficiency in relational databases (Snowflake, Redshift, etc), database concepts and dimensional modeling
  • Experience in data cleansing, data validation and data wrangling
  • Proficiency in SQL and Scripting (Unix sell scripts, Python)
  • Hands on experience in trouble shooting complex ETL and SQL problems
  • Hands on experience in designing and building data pipelines in AWS cloud using S3, Lambda, API Gateway, RDS, Redshift, etc.

Good to have Skills:

  • Experience in data pipeline development using ETL tool, Informatica IICS
  • Experience in scripting languages, Unix scripting and Python.

Technical Qualifications

  • 6+ years of experience within the field of application/platform engineering or related technical work including business intelligence, analytics.
  • 4+ years of experience with AWS Senior Cloud Data Engineering, management, maintenance, or architecting, implementing best practices and industry standards.
  • Experience with data warehousing platforms such as Snowflake, Redshift or similar.
  • Strong knowledge and established experience with AWS services including but not limited to: S3, EC2, RDS, Lambda, Cloud Formation, Kinesis, Data Pipelines, EMR, Step Functions, VPC, IAM, and Security Groups.
  • Experience with DB technologies (e.g., SQL, Python, PostgreSQL, AWS Aurora, AWS RDS, MongoDB, Redis).
  • Experience with CI/CD tools, pipelines, and scripting for automation. (GitHub Actions, Jenkins, AWS Code Pipeline tools, Cloud formation and Terraform).
  • High degree of knowledge in IAM Roles and Policies
  • Strong knowledge configuring AWS cloud monitoring and alerts for cloud resource availability.
  • Strong scripting experience using PowerShell and/or Python.
  • High degree of knowledge in PaaS and SaaS application performance.
  • Understand enterprise level application architecture diagrams and IT security requirements.