This job is with S&P; Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ business community. Please do not contact the recruiter directly. About the Role: Grade Level (for internal use): 11 We are seeking a hands-on Senior Data Engineer / Data Platform Lead to support our offshore team in India. This role focuses on executing data pipeline onboarding, migration, and support activities within our enterprise data platform. You will work closely with the Databricks team and internal stakeholders to ensure smooth transition, ongoing refinement, and reliable operation of data pipelines and integrations in a Databricks-on-AWS lakehouse workplace . Databricks on AWS positions data engineering around governed ingestion, transformation, and delivery of high-quality data for analytics and downstream use cases. This is a delivery-focused role requiring strong technical expertise in data engineering, with responsibilities for supporting data onboarding, pipeline maintenance, platform support, and cloud-native operational excellence.



You will lead a small team of engineers, providing technical guidance and ensuring high-quality execution across scalable, secure, and governed data workflows leveraging Amazon S3 , AWS Glue , AWS IAM , and AWS Lake Formation alongside Databricks capabilities such as Delta Lake , Unity Catalog , and open table format interoperability where appropriate. Key Responsibilities Data Pipeline Support & Migration Assist in the migration of existing data pipelines to the Databricks platform, following established patterns and runbooks. Support the ongoing operation, troubleshooting, and optimization of pipelines post-migration. Implement and follow engineering best practices for data ingestion, transformation, and monitoring. Ensure pipelines are reliable, performant, and maintainable. Support data ingestion and storage patterns using Amazon S3 as the core cloud object store for lakehouse data layers, with Dat

📌 Lead, Data Engineering (Telangana)
🏢 S&P Global
📍 Telangana