- Data Engineering Pipeline Development
- Build and maintain scalable data pipelines using Palantir Foundry Code Repositories Pipelines Ontology
- Perform data ingestion transformation and integration from multiple sources
- Ensure data quality integrity and reliability across datasets
- Foundry Platform Development
- Develop and manage workflows using Foundry tools Pipeline Builder Code Workbook Workshop Apps
- Implement business logic using Python SQL or PySpark
- Work with Foundry Ontology to model business entities and relationships
- Application Development
- Build user facing applications using Foundry Workshop
- Create dashboards and analytics for business users
- Enable real time or near real time insights
- Collaboration Stakeholder Management
- Collaborate closely with business teams to understand requirements
- Translate business problems into data solutions
- Provide technical guidance on best practices
- Performance Optimization
- Optimize data pipelines for performance and scalability
- Monitor jobs and troubleshoot failures
- Implement efficient data models
- Technical Skills
- Hands on experience with Palantir Foundry mandatory for mid senior roles
- Strong SQL skills and experience with relational databases
- Proficiency in Python PySpark Spark
- Experience with ETL ELT pipeline design
- Knowledge of data modeling concepts
- Platform Knowledge
- Foundry components
- Code Repositories
- Ontology
- Pipeline Builder
- Workshop Slate Quiver
- Familiarity with distributed data processing
- General Skills
- Strong problem solving skills
- Ability to work in agile environments
- Valuable communication and stakeholder engagement
Technical Requirements:
- Technology Data Engineering Palantir Foundry
Additional Responsibilities:
- Experience with big data technologies Hadoop Spark Kafka
- Knowledge of cloud platforms AWS Azure GCP
- Experience in data governance and security
- Prior consulting or client facing experience