Data Engineer

Role Overview:

Our financial services client is seeking a passionate and highly motivated Data Engineer to join their Enterprise Data Management team. In this role, you will design, build, and maintain data pipelines and ETL jobs that are essential for allowing the enterprise to access and interpret data effectively. You will be integral in architecting and delivering modern data solutions, working cross-functionally with Analytics, IT, and business teams to ensure reliable data pipelines for performance and scalability.

In this role, you will join a team that values and encourages collaboration and peer-to-peer knowledge sharing. We foster a culture where ideas are freely exchanged, and every team member is encouraged to expand their knowledge both technically and within the business context. We celebrate everyone's wins and recognize that each project and business problem we tackle is an opportunity for collective learning. Our guiding principle is to make data easy and accessible for everyone to use, enabling better decision-making across the company.

Responsibilities:

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Manage and support data engineering platform tools using technologies such as Microsoft SQL Server, SSMS, SSIS, REST APIs, and Azure Cloud Platform to move data from various heterogeneous data sources ranging from flat files, Excel, Oracle, SQL Server, XML, XSL files, and JSON files.
• Design and develop a robust data engineering infrastructure to support optimal extraction, transformation, and loading (ETL) of data from diverse sources, utilizing SQL, Microsoft Azure, AWS, and advanced big data technologies.
• Develop and perform unit tests; maintain up-to-date code in source control.

• Collaborate on code reviews and adhere to change management processes to deploy changes to production systems.
• Troubleshoot issues reported by users and perform root cause analysis for production issues with minimal guidance.
• Participate in on-call rotation to provide support and implement fixes as needed.
• Continuously learn about the business and the data that supports it.

Qualifications:

• We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Engineering, Mathematics, Information Systems, or related technical discipline.
• Proficient in T-SQL, Stored Procedures, Functions, and SSIS with capability to implement REST APIs. Experienced with cloud data platforms like Microsoft Azure and Microsoft Fabric, ensuring scalable data solutions.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing big data' data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured and semi-structured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large, disconnected datasets.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience in unit testing, data quality validation, and data analysis.
• Excellent verbal and written communication skills.
• Good interpersonal skills with proven problem-solving abilities.
• Knowledge of cloud data and platform security, with a preference for AWS and Azure.

Critical Skills:

• Customer Focus: Strong drive to meet data consumer needs and deliver effective solutions.
• Critical Thinking: Ability to analyze data and solve problems to reach well-reasoned solutions.
• Team Mentality: Ability to work effectively within a team to achieve common goals.
• Learning Agility: Openness to learning new technologies and methodologies to maintain a competitive edge.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.