Epicareer Might not Working Properly
Learn More

Senior Software Engineer, Data Platform

Salary undisclosed

Apply on


Original
Simplified
**CAN'T SIT REMOTELY OUT OF CALIFORNIA**

Requirements for This Role:
  • Experience: 7+ years working with modern data technologies and/or building data-intensive distributed systems.
  • Programming Skills: Expert-level proficiency in Java/Scala or Python, with a proven ability to write high-quality, maintainable code.
  • Database and Scripting: Strong knowledge of SQL and Bash.
  • Cloud Technologies: Experience in leveraging and building cloud-native technologies for scalable data processing.
  • Data Systems: Previous experience with both batch and streaming systems, understanding their limitations and challenges.
  • Data Processing Technologies: Familiarity with a range of technologies such as Flink, Spark, Polars, Dask, etc.
  • Data Storage Solutions: Knowledge of various storage technologies, including S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.
  • Data Formats and Serialization: Experience with multiple data formats and serialization systems like Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.
  • ETL Pipelines: Proven track record of managing complex data ETL pipelines using tools like Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.
  • Schema Governance: Prior experience dealing with schema governance and schema evolution.
  • Data Quality Control: Experience in developing data quality control processes to detect and address data gaps or inaccuracies.
  • Mentorship: A desire to mentor less experienced team members and promote best practices and high standards in code quality.
  • Problem-Solving: Strong technical problem-solving abilities.
  • Agile Environment: Proven capability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and handle the demands of a trading environment efficiently.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job