Apply on
Original
Simplified
We are looking for Pyspark Developer for our client in Charlotte, NC
Job Title: Pyspark Developer
Job Location: Charlotte, NC
Job Type: Contract
Job Description:
- 6+ years of experience in Design, develop, and maintain ETL processes using PySpark for data transformation and loading into data lakes or warehouses.
- 6+ years of experience in writing efficient and reusable Python scripts for data manipulation, integration, and analysis.
- Experience in developing and implementing Shell scripts for automation of data processing tasks.
- Experience in Managing and scheduling data workflows using Autosys to ensure timely and reliable data availability.
- Strong proficiency in SQL and experience with relational databases (e.g., MySQL, SQL Server).
- Hands on experience in optimizing data processing performance and troubleshoot issues in data pipelines.
- Knowledge and experience with CI/CD, Agile tools, Source control and designing tools.
- Experience working with Agile Methodology.
- Develop, conduct code reviews, Test and Deploy code.
- Provide fixes to issues/bugs reported from test and production environment.
- Provide support during SIT and UAT.
- Fix defects raised in production.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Similar Jobs