Lead Data Engineer
Apply on
Availability Status
This job is expected to be in high demand and may close soon. We’ll remove this job ad once it's closed.
Overall 12+ yrs
Primary Skills:
ETL Fundamentals, HDFS, Hive, MapReduce, Modern Data Platform Fundamentals, Oozie, PLSQL, Python, Spark - Pyspark, Spark - Scala, SQL
Secondary Skills:
Java
Specialization:
Big Data Engineering: Associate BI Engineer
Job requirements:
Previous experience as a data engineer or in a similar role Strong and hands-on Knowledge of programming languages (e.g. Java and Python).
Experience with popular Python frameworks such as Django, Flask or Pyramid.
In-depth understanding of the Python software development stacks, ecosystems, frameworks and tools such as Numpy, Scipy, Pandas, Dask, spaCy, NLTK, sci-kit-learn and PyTorch.
Experience with popular Python frameworks pysaprk,databricks,flink nosql db could be added advantages.
Preferred skills and qualifications
Technical expertise with data models, data mining, and segmentation techniques.
Hands-on experience with SQL database design Great numerical and analytical skills Data engineering certification.
Familiarity with database technologies such as SQL and NoSQL.
Excellent problem-solving ability with solid communication and collaboration skills.
Knowledge of data science and machine learning concepts and tools.
A working understanding of cloud platforms such as AWS, Google Cloud or Azure.
Contributions to open-source Python projects or active involvement in the Python community.