PySpark Developer - Charlotte, NC (Hybrid) - C2C - CH
Salary undisclosed
Apply on
Original
Simplified
Role: PySpark Developer
Locations: Charlotte, NC (Hybrid Onsite)
Duration: 12+ Months Contract
Note: Candidate needs to be in the office 3 Days every week. Local or candidates from Adjacent states only.
Job Description:
- 6+ years of experience in Design, develop, and maintain ETL processes using PySpark for data transformation and loading into data lakes or warehouses.
- 6+ years of experience in writing efficient and reusable Python scripts for data manipulation, integration, and analysis.
- Experience in developing and implementing Shell scripts for automation of data processing tasks.
- Experience in Managing and scheduling data workflows using Autosys to ensure timely and reliable data availability.
- Strong proficiency in SQL and experience with relational databases (e.g., MySQL, SQL Server).
- Hands-on experience in optimizing data processing performance and troubleshoot issues in data pipelines.
- Knowledge and experience with CI/CD, Agile tools, Source control and designing tools.
- Experience working with Agile Methodology.
- Develop, conduct code reviews, Test and Deploy code.
- Provide fixes to issues/bugs reported from test and production environment.
- Provide support during SIT and UAT.
- Fix defects raised in production.
Awaiting your quick response. Thanks!
P.S. Empower is a top vendor to clients such as Apex Systems LLC, Sogeti, Randstad, Capgemini, UST and more.
Thanks
Mayank Verma
Technical Recruiter | Empower Professionals
......................................................................................................................................
Phone: x 364
Fax: | 100 Franklin Square Drive Suite 104 | Somerset, NJ 08873
Certified NJ and NY Minority Business Enterprise (NMSDC)
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Report this job Similar Jobs