A global professional services organisation is expanding its AI and data engineering capabilities and is looking for experienced AI Data Engineers to join its Mumbai team.

This is a hands-on engineering role focused on building the modern lakehouse and data infrastructure that powers enterprise AI applications. You will design and develop scalable data platforms on Azure Databricks and ADLS Gen2, build production-grade ETL/ELT pipelines, and create governed, AI-ready data products supporting RAG and agentic AI workflows.

Key Responsibilities

- Design, build and evolve a modern Azure lakehouse using ADLS Gen2, Azure Databricks and Delta Lake.
- Implement medallion architecture (Bronze → Silver → Gold) for scalable and governed data processing.
- Build robust batch and streaming ETL/ELT pipelines using Azure Data Factory, Databricks Workflows and Structured Streaming.
- Develop reusable, metadata-driven ingestion frameworks and connectors for efficient onboarding of new data sources.
- Build curated, AI-ready data products to support RAG, vector search and agentic AI applications.
- Prepare data and content for embeddings and retrieval through Azure AI Search.
- Implement data governance, lineage, classification and access controls using Microsoft Purview and Databricks Unity Catalog.
- Optimise data platform performance and cost through partitioning, clustering, compaction,



incremental processing and CDC.
- Establish data quality testing, CI/CD and pipeline observability across production workloads.
- Work closely with AI Developers, Product Owners, Cloud Architects and Governance & Risk teams on shared AI and data capabilities.
- Support secure handling and segregation of sensitive and regulated data.

Key Requirements

- Bachelor's degree in Computer Science, Engineering, Data Science or a related technical discipline.
- Minimum 4+ years of experience building production data pipelines and data platforms, with hands-on ownership of ETL/ELT development.
- Robust practical experience designing and working with modern lakehouse architectures.
- Hands-on expertise across Azure Databricks, ADLS Gen2 and Azure Data Factory and/or Synapse.
- Strong programming skills in Python and SQL.
- Proven experience with PySpark / Spark SQL at scale.
- Strong working knowledge of Delta Lake and medallion architecture.
- Familiarity with data formats including Parquet, Avro and JSON.
- xperience with RAG/vector search, streaming/CDC, dbt, Great Expectations, Delta Live Tables, Terraform, Kafka/Event Hubs or Azure AI Search would be advantageous.

Interested parties please send your resume to Abhishrut Banerjee at .
Regrettably, only shortlisted candidates will be contacted.

📌 AI Data Engineer (Mumbai, India)
🏢 Amethyst Partners
📍 India