Overview

We are looking for a Senior Lead – Databricks & Data Modernization to lead the design and implementation of a data modernization program involving both recent data feature development in Databricks and the migration of existing capabilities from Palantir Foundry to Databricks.
The role requires a strong combination of Databricks engineering, data architecture, technical leadership and program execution skills. The candidate will be responsible for translating business and technical requirements into scalable Databricks solutions, guiding the engineering team, driving the Palantir-to-Databricks migration, and ensuring high-quality delivery.
The Senior Lead will work closely with customer stakeholders, enterprise/data architects, product owners, engineering teams and AI/ML teams and will be expected to take ownership of technical decisions and end-to-end delivery.

Responsibilities

1. Technical Leadership & Solution Design
• Lead the design and development of scalable Databricks-based data solutions.
• Translate business requirements into technical architecture,



data models and implementation plans.
• Define appropriate patterns for data ingestion, transformation, processing, storage and serving.
• Establish engineering standards, coding standards and reusable frameworks for the Databricks development team.
• Make technology and design decisions balancing performance, scalability, maintainability, security and cost.
• Review technical designs and code produced by the engineering team.
• Identify opportunities to modernize and simplify existing solutions.

2. Palantir Foundry → Databricks Migration
• Lead the technical assessment and migration of existing Palantir Foundry capabilities to Databricks.
• Analyze existing Foundry pipelines, datasets, transformations, business rules and dependencies.
• Develop migration strategies and target-state architectures for different Foundry capabilities.
• Define appropriate Databricks-native replacements rather than simply

📌 AT&T Databricks (Gurugram)
🏢 Prodapt
📍 Gurugram