About the Role:

Grade Level (for internal use):
11
We are seeking a hands-on Senior Data Engineer / Data Platform Lead to support our offshore team in India. This role focuses on executing data pipeline onboarding, migration, and support activities within our enterprise data platform. You will work closely with the Databricks team and internal stakeholders to ensure smooth transition, ongoing refinement, and reliable operation of data pipelines and integrations in a Databricks-on-AWS lakehouse workplace. Databricks on AWS positions data engineering around governed ingestion, transformation, and delivery of high-quality data for analytics and downstream use cases.

This is a delivery-focused role requiring strong technical expertise in data engineering, with responsibilities for supporting data onboarding, pipeline maintenance, platform support, and cloud-native operational excellence. You will lead a small team of engineers, providing technical guidance and ensuring high-quality execution across scalable, secure, and governed data workflows leveraging Amazon S3, AWS Glue, AWS IAM,



and AWS Lake Formation alongside Databricks capabilities such as Delta Lake, Unity Catalog, and open table format interoperability where appropriate.

Key Responsibilities

Data Pipeline Support & Migration
- Assist in the migration of existing data pipelines to the Databricks platform, following established patterns and runbooks.
- Support the ongoing operation, troubleshooting, and optimization of pipelines post-migration.
- Implement and follow engineering best practices for data ingestion, transformation, and monitoring.
- Ensure pipelines are reliable, performant, and maintainable.
- Support data ingestion and storage patterns using Amazon S3 as the core cloud object store for lakehouse data layers, with Databricks processing and transformation built on top of that storage foundation.
- Contribute to migration and optimization activities involving AWS Glue for metadata cataloging,

📌 Lead, Data Engineering (Hyderabad)
🏢 S&P Global
📍 Hyderabad