We are seeking an experienced Lead Data Engineer to join the Marsh Innovation and Data Office (IDO) - Data Strategy team in Mumbai. This hybrid role requires at least two days per week in the office and focuses on designing, building, and maintaining high-performance data pipelines across our Databricks analytics platform.
IDO Data Strategy is a global team of data engineering professionals working to deliver scalable, reliable data pipelines that power business decision-making across Marsh globally. The group has a footprint within the India Knowledge Services (IKS) function at Marsh Global Capability Centre in Mumbai, India. IKS is a hub of several hundred professionals that work with Marsh businesses across a wide range of capabilities.
We will count on you to:
Pipeline Design & Development (Primary Focus – 60%)
- Design, build, and maintain production data pipelines in Databricks that transform raw data from ingestion workspace through transformation workspace and into consumption workspace following a lakehouse architecture.
- Write clean,
optimized SQL and Python code to implement productive data transformations, ensuring high performance and maintainability across all three workspaces.
- Develop and enforce DBT (Data Build Tool) workflows for reproducible, version-controlled data transformations; define and manage data models, tests, and documentation.
- Implement CI/CD pipelines using GitHub Actions (or similar) to automate testing, validation, and deployment of data pipeline code across development, staging, and production environments.
- Manage code repositories using GitHub, including pull request workflows, code review standards, branch strategies, and version control best practices.
- Create comprehensive data mappings, transformation logic, and business rules documentation to ensure reliability and transparency of data lineage across ingestion, transformation, and consumption layers.
- Validate data quality and correctness through automated testing f
📌 Lead Data Engineer (Mumbai)
🏢 Marsh
📍 Mumbai