Palantir Foundry, Pyspark Data Engineer/Lead
Apply on
Position: Palantir Foundry, Pyspark Data Engineer/Lead
Location: CA. 100% Remote
Key Skills: Palantir Foundry, Python, spark, AWS,Pyspark
Responsibilities
- Preferred candidate having experience with Palantir Foundry (Code Repository, Contour, Data connection and workshop). Palantir Foundry experience is must to have.
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Provide technical support and usage guidance to the users of our platform's services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
Experience building and optimizing data pipelines in a distributed environment
Experience supporting and working with cross-functional teams
Proficiency working in Linux environment
4+ years of advanced working knowledge of Palantir Foundry, SQL, Python, and PySpark
2+ years of experience with using a broad range of AWS technologies
Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
Experience with platform monitoring and alerts tools