Epicareer Might not Working Properly
Learn More

Spark/Scala Developer

  • Full Time, onsite
  • Marlabs LLC
  • Hybrid2 days in a week, United States of America
Salary undisclosed

Apply on


Original
Simplified

Spark/Scala Developer

Location: NYC, NY

Duration: 18 Months

Job Description

10+ years of Develop and maintain data pipelines using Apache Spark and Scala to process large volumes of data efficiently
Ability to write and optimize code in Scala for Spark applications.
Designing, creating, and maintaining Scala-based applications.
Create real-time data pipelines using Apache Spark
Build and maintain SQL databases using Spark SQL
Build and maintain a codebase for Apache Spark data processes
Develop distributed code using the Scala programming language
Flow Control in Scala, Functions in Scala, Data Structures in Scala
Build, deploy, and run Spark scripts
Transform structured data using SparkSQL, DataSets, and DataFrames
Optimize Spark jobs through partitioning, caching, and other techniques
Process continual streams of data with Spark Streaming
Should have understanding on Spark SQL, DataSets, Running Spark on Clusters, Scala Libraries
Experience with streaming data architectures and technologies for real-time and low-latency data processing.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job