Roles and Responsibilities
Design, develop, and maintain large-scale data pipelines using Palantir Foundry.
Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
Develop complex SQL queries to extract insights from large datasets.
Implement automation scripts using Airflow for workflow management and scheduling.
Ensure data quality by implementing data validation rules and monitoring dashboards.
Desired Candidate Profile
Solid understanding of Pyspark, AWS services (e.g., S3), and cloud computing concepts.
Experience working with Ontology or similar tools is a plus.
Proficiency in writing productive SQL queries and developing complex reports using various reporting tools.