Reports To: Director Data & AI Platform Engineering
Team: Databricks AI & Data Platform / Snowflake Modern Data Platform
ROLE SUMMARY
Ecolab is seeking a Senior Manager Data Engineering Platform to lead enterprise data platform capabilities that enable analytics AI and business decision-making. This role owns platform operations integration observability monitoring data quality lineage cataloging security and engineering enablement across Databricks Snowflake and Azure-based data platforms. The leader will deliver a secure scalable reliable and cost-efficient foundation for ingestion ETL/ELT orchestration governance semantic and ontology capabilities and production support across enterprise domains.
KEY RESPONSIBILITIES
- Lead the enterprise data engineering platform operating model across Databricks Snowflake Azure Data Lake ingestion transformation orchestration governance observability monitoring cataloging lineage and data quality.
- Own platform administration including workspaces clusters SQL warehouses Unity Catalog Snowflake roles resource monitors workload isolation and governance controls.
- Define observability and monitoring standards for pipelines workflows compute storage integrations data freshness data quality lineage performance reliability cost SLAs and SLOs.
- Drive automation through self-service provisioning reusable templates CI/CD testing frameworks release automation and Infrastructure-as-Code.
- Define integration patterns across Databricks Snowflake Azure Data Factory dbt Kafka/Event Hubs APIs enterprise applications databases file sources BI tools and downstream platforms.
- Drive semantic and ontology layer capabilities with Data Engineering to enable consistent business definitions reusable data products governed consumption and trusted analytics.
- Set ETL/ELT standards for batch incremental streaming CDC API-based and event-driven pipelines using modern DataOps practices.
- Improve production readiness through data quality controls lineage metadata cataloging alerting incident response runbooks root-cause analysis and continuous improvement.
- Own data security and access governance including Zero Trust RBAC ABAC PBAC data masking encryption secrets management audit logging policy enforcement and compliance controls.
- Lead a high-performing platform engineering team through hiring coaching performance management career development workforce planning and an inclusive engineering culture.
- Partner with Data Engineering AI/ML Engineering Security Architecture and business teams to align the platform roadmap with enterprise priorities.
REQUIRED QUALIFICATIONS
- 10 years of experience in data engineering data platform engineering cloud platform engineering or enterprise platform operations including 4 years managing engineering teams.
- Hands-on experience administering Databricks and Snowflake environments including Unity Catalog workspace management cluster policies SQL warehouses roles resource monitors and workload governance.
- Solid experience operating cloud-based data platforms on Microsoft Azure; AWS or Google Cloud exposure is a plus.
- Experience with CI/CD Infrastructure-as-Code Terraform or similar tools platform automation environment management and release governance.
- Strong understanding of integration ETL/ELT CDC streaming orchestration metadata cataloging lineage data quality monitoring and DataOps practices using tools such as Azure Data Factory Airflow dbt Kafka/Event Hubs or similar platforms.
- Experience implementing observability alerting dashboards SLA/SLO reporting incident management and production support for enterprise data platforms.
- Strong understanding of data security and access governance including Zero Trust RBAC ABAC PBAC identity management audit logging encryption data masking secrets management and data protection.
PREFERRED QUALIFICATIONS
- Databricks and/or SnowPro certifications (Administrator Data Engineer).
- Experience supporting multiple business verticals or a hub-and-spoke platform operating model.
- Exposure to LangGraph MLflow or other AI/ML platform tooling.
- Experience with BI semantic layers MLOps LLMOps data cataloging lineage observability data quality or monitoring tools integrated with Databricks and Snowflake.
- Experience with lakehouse architecture medallion patterns Delta Lake data sharing semantic layers and reusable data products at enterprise scale.
- Knowledge of Spark and Snowflake performance tuning warehouse sizing cluster policies auto-scaling cost controls and platform FinOps.
- Exposure to orchestration and workflow tools such as Azure Data Factory Airflow Databricks Workflows dbt Cloud or similar platforms.
- Experience with streaming and near-real-time patterns using Kafka Azure Event Hubs Spark Structured Streaming or similar technologies.
- Familiarity with governance and cataloging platforms such as Microsoft Purview Unity Catalog Collibra Alation Atlan OpenLineage or similar tools.
- Experience with platform reliability practices including SRE health dashboards automated alerting incident response capacity forecasting resiliency testing and disaster recovery.
Required Experience:
Manager
📌 Senior AI Engineer Manager (Bengaluru)
🏢 Ecolab
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.