Epicareer Might not Working Properly
Learn More

Senior Big Data Engineer ? Databricks

  • Full Time, onsite
  • Talent Software Services, Inc
  • Remote Hybrid, United States of America
Salary undisclosed

Checking job availability...

Original
Simplified
Senior Big Data Engineer - Databricks

Job Summary: Talent Software Services is in search of a Senior Big Data Engineer - Databricks for a contract position that can be worked 100% remotely. The opportunity will be one year with a strong chance for a long-term extension.

Position Summary:

This job takes the lead in providing complex application development services in the client's Google Cloud Platform environment, typically as part of a project team or in an application support role. Databricks Engineers analyze, design, code, test, and implement more complex systematic solutions to meet customer requirements that adhere to client's IT standards and policies. They also provide general support to maintain more complex applications that meet the service levels, system availability, performance, and quality levels required by their customers. Able to guide and mentor less experienced team members.

Primary Responsibilities/Accountabilities:

  • Takes a lead role in analyzing, designing, coding, testing, and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates, and budgets with minimal or no defects.
  • Utilizes and participates in the more complex full system development life cycle, per current client SDLC standards.
  • Takes a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrates on providing innovative solutions to more complex business needs.
  • Performs work in compliance with all client and client's IT standards, policies, and procedures.
  • Actively takes a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead, and Project Manager, based upon level of experience.
  • Effectively communicates with team members, customers, partners, and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions, and providing accurate and concise documentation.
  • Other duties as assigned or requested.

Qualifications:
  • Bachelor's degree in Information Technology, Computer Science or a closely related field
  • 5 years of experience as a developer
  • 3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows.
  • Deep understanding of Spark and its core concepts. They should be proficient in Spark programming Python, Pyspark
  • Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. They should be familiar with ETL and have hands-on experience with data pipelines and data orchestration tools.
  • Expertise with Google Cloud Platform, including services like Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow.
  • Problem-solving, root cause analysis, and issue resolution
  • Demonstrated leadership skills
  • Experience in Healthcare or Health Insurance Industry
  • Experience with Databricks, Google Cloud Platform, application development tools, business processes, software development life cycle used by client's enterprise

Preferred:
  • Master's degree in Information Technology, Computer Science, or a closely related field
  • 5 years of experience as a developer with demonstrated skills in: Databricks and Python/Pyspark
  • Google Cloud Platform: Big Query and PostgreSQL
  • Certifications such as Python, Databricks, Google Cloud Platform

If this job is a match for your background, we would be honored to receive your application!

Providing consulting opportunities to TALENTed people since 1987, we offer a host of opportunities including contract, contract to hire, and permanent placement. Let's talk!

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job
Senior Big Data Engineer - Databricks

Job Summary: Talent Software Services is in search of a Senior Big Data Engineer - Databricks for a contract position that can be worked 100% remotely. The opportunity will be one year with a strong chance for a long-term extension.

Position Summary:

This job takes the lead in providing complex application development services in the client's Google Cloud Platform environment, typically as part of a project team or in an application support role. Databricks Engineers analyze, design, code, test, and implement more complex systematic solutions to meet customer requirements that adhere to client's IT standards and policies. They also provide general support to maintain more complex applications that meet the service levels, system availability, performance, and quality levels required by their customers. Able to guide and mentor less experienced team members.

Primary Responsibilities/Accountabilities:

  • Takes a lead role in analyzing, designing, coding, testing, and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates, and budgets with minimal or no defects.
  • Utilizes and participates in the more complex full system development life cycle, per current client SDLC standards.
  • Takes a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrates on providing innovative solutions to more complex business needs.
  • Performs work in compliance with all client and client's IT standards, policies, and procedures.
  • Actively takes a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead, and Project Manager, based upon level of experience.
  • Effectively communicates with team members, customers, partners, and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions, and providing accurate and concise documentation.
  • Other duties as assigned or requested.

Qualifications:
  • Bachelor's degree in Information Technology, Computer Science or a closely related field
  • 5 years of experience as a developer
  • 3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows.
  • Deep understanding of Spark and its core concepts. They should be proficient in Spark programming Python, Pyspark
  • Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. They should be familiar with ETL and have hands-on experience with data pipelines and data orchestration tools.
  • Expertise with Google Cloud Platform, including services like Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow.
  • Problem-solving, root cause analysis, and issue resolution
  • Demonstrated leadership skills
  • Experience in Healthcare or Health Insurance Industry
  • Experience with Databricks, Google Cloud Platform, application development tools, business processes, software development life cycle used by client's enterprise

Preferred:
  • Master's degree in Information Technology, Computer Science, or a closely related field
  • 5 years of experience as a developer with demonstrated skills in: Databricks and Python/Pyspark
  • Google Cloud Platform: Big Query and PostgreSQL
  • Certifications such as Python, Databricks, Google Cloud Platform

If this job is a match for your background, we would be honored to receive your application!

Providing consulting opportunities to TALENTed people since 1987, we offer a host of opportunities including contract, contract to hire, and permanent placement. Let's talk!

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job