Epicareer Might not Working Properly
Learn More
Please Turn on your JavaScript

Epicareer might not working properly because your browser javascript is turned off.

What is JavaScript?

JavaScript is like the magic behind making websites interactive. Basically, it makes Epicareer more enjoyable and engaging.
How do i turn this on?
Find tutorial for your browser below :
  1. Make sure the webpage is open.
  2. In the Safari app on your Mac, choose Safari > Preferences, then click Security.
  3. Make sure the Enable JavaScript checkbox is selected.
  4. Click Websites.
  5. On the left, click Content Blockers.
  6. Make sure Off is chosen in the pop-up menu next to the website.
  7. On the left, click Pop-up Windows.
  8. Make sure Allow is chosen in the pop-up menu next to the website.
Visit Site here
  1. Open Chrome on your computer.
  2. Click. then Settings.
  3. Click Privacy and Security.
  4. Click Site settings.
  5. Click JavaScript.
  6. Select Sites can use Javascript.
Visit Site here
  1. If you're running Windows OS, in the Firefox window, click Tools > Options.
  2. Tip: If you're running Mac OS, click the Firefox drop-down list > Preferences.
  3. On the Content tab, click the Enable JavaScript check box.
Visit Site here
  1. Click the "Settings and more" icon at the top right of the Edge browser window.
  2. Click Settings.
  3. From the Settings menu, click Cookies and site permissions.
  4. Scroll down and click on JavaScript.
  5. In the JavaScript window, toggle the slider to "on" or "allowed."
  6. Close the Settings tab.
  7. Refresh the page.
Visit Site here
  1. Go to Settings.
  2. Click Advanced in the left sidebar, and click Privacy & security.
  3. Under Privacy and security, click Site settings.
  4. Click JavaScript.
  5. At the top, turn on or off Allowed (recommended).
Visit Site here
Any Question? Contact us
logo
Jobs or company...
T

Senior Data Ingestion Engineer

Salary undisclosed

Apply on

Dice
Original
Simplified

Senior Data Ingestion Engineer

Most important for this role (key skills)

  • Kafka (data streaming)
  • Python/PySpark
  • AWS
  • Databricks Platform (Unity Catalog)

Role Overview:

This role will be responsible for conducting data ingestion and platform management on the Databricks platform. This role requires a deep understanding of:

  • Data Lake ingestion processes and best practices
  • ETL/ELT implementation
  • CI/CD
  • System integration tools
  • Data pipeline management
  • Data Streaming (Kafka)

About the role:

  • Ingest data from a variety of source systems and tailor ingestion approaches on a per-system basis
  • Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform
  • Optimize data pipelines for scalability and speed
  • Document ingestion and integration flows and pipelines
  • Use Airflow to schedule and automate ingestion jobs
  • Manage metadata and master data in technical data catalog
  • Ensure ELT/ETL design meets required security and compliance guidelines, and ensure PII management, flagging and risk assessment during ingestion
  • Maintain ETL/ELT pipeline infrastructure and implement automated monitoring strategies
  • Ensure adherence to SDLC best practices

About you:

  • Bring 5+ years of experience in data engineering, ingestion pipelining, Data Streaming using Kafka and ETL/ELT
  • Hold a bachelor s degree in computer science, engineering, statistics, or related field
  • Have hands-on experience with and understanding of the following:
    • Kafka ( minimum 2 years)
    • AWS (minimum 2 years)
    • Python/PySpark (minimum 3 years)
    • Spark/Scala
    • Databricks
    • Unity Catalog
    • SQL
    • ETL/ELT development, monitoring and pipelining using tools such as Apache Airflow
    • Ingestion tools such as Dell Boomi
    • Data quality guidelines
    • CI/CD pipelines
    • Agile
    • Git and version control
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job
Similar Jobs