Data Engineer for Data Platform
Apply on
Job Description
Team Introduction
The Data Platform team works on building data infrastructures and data products to support business engineering teams.
As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
Responsibility
Design and build data transformations efficiently and reliably for different purposes (e.g. reporting, growth analysis, and multi-dimensional analysis)
Design and implement reliable, scalable, robust and extensible big data systems that support core products and business
Establish solid design and best engineering practice for engineers as well as non-technical people
Requirements
BS or MS degree in Computer Science or related technical field or equivalent practical experience
Experience in the Big Data technologies(Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc.)
Experience with performing data analysis, data ingestion and data integration
Solid communication and collaboration skills
Experience with ETL (Extraction, Transformation & Loading) and architecting data systems
Experience with schema design and data modeling
Experience in writing, analyzing and debugging SQL queries
Deep understanding of various Big Data technologies
Passionate and self-motivated about technologies in the Big Data area