Epicareer Might not Working Properly
Learn More

Big Data Engineer

Salary undisclosed

Apply on


Original
Simplified

Job Description:

We are seeking a skilled Data Engineer to join our team, focusing on ETL support for credit card processing and data products. In this role, you will be responsible for building and maintaining data pipelines, batch processing applications, and supporting production environments. The ideal candidate will have strong expertise in Big Data engineering, particularly in ETL development, and will work closely with Product Owners to ensure efficient requirement gathering, code maintenance, and testing.

Key Responsibilities:

  • Build and manage robust data pipelines and ETL processes for credit card data.
  • Leverage technologies such as PySpark and AWS services, including Glue, S3, EMR, and Lambda, to support batch processing applications.
  • Use Snowflake and SQL to build and maintain flexible, scalable data storage solutions.
  • Collaborate with Product Owners to gather requirements, maintain and test code for production-ready data solutions.
  • Provide production support for data systems and applications.
  • Ensure system reliability and scalability for data products used across the enterprise.

Required Skills and Experience:

  • Strong expertise in Big Data Engineering with hands-on experience in ETL processes.
  • Proficiency in PySpark, AWS (Glue, S3, EMR, Lambda), and SQL.
  • Familiarity with Snowflake or similar data warehousing solutions.
  • Experience in building ETL pipelines and batch processing applications.
  • Proven ability to work in an enterprise environment with at least 2 years of experience in building data products.
  • Excellent communication skills to work with cross-functional teams and Product Owners.
  • Strong problem-solving skills and ability to provide production support.

Preferred Qualifications:

  • Experience working in the credit card or financial services industry.
  • Familiarity with testing frameworks and methodologies for data pipelines.

Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job