Job Description

Senior Data Engineer - Databricks | PySpark | dbt | Lakehouse Engineering

/n

/n

⚠️ This is NOT a typical Data Engineering position.

/n

/n

We are looking for a hands-on Senior Data Engineer with strong, production-grade Databricks experience - someone who has actually built and optimized Lakehouse/Medallion architectures, PySpark & dbt pipelines, PostgreSQL data layers, and CI/CD workflows , rather than someone with only surface-level exposure to these technologies.

/n

/n

⚠️ If Databricks is not a core part of your recent hands-on experience, this role may not be the right fit.

/n

/n

Job Title: Senior Data Engineer

/n

Specialization: Data Engineering | Databricks | Lakehouse | Data Platforms | AI-Ready Data

/n

Experience: 5+ Years

/n

Location: BNG | HYD | PUN | MUM | GGN

/n

Work Model: Hybrid

/n

/n

What We're Looking For

/n

/n

Mandatory-Strong hands-on experience required:

/n

/n

- Databricks – with practical experience building production data platforms and Lakehouse architectures.

/n

- PySpark – strong production experience working with non-trivial data volumes.

/n

- Python – advanced programming and data engineering experience.

/n

- dbt – hands-on experience with staging, transformations, incremental models, testing, and documentation.

/n

- CI/CD – Azure Dev Ops – experience deploying and managing data assets through CI/CD pipelines.

/n

- PostgreSQL – database design, schema management, query optimization,



and performance tuning.

/n

- Solid understanding of Medallion Architecture and Delta Lake .

/n

- Advanced SQL and experience working with large-scale datasets.

/n

/n

Good to Have

/n

/n

- MLflow and experience supporting ML/data science workflows.

/n

- Lang Chain or similar AI/Agent frameworks.

/n

- Exposure to AI Agents / AI-ready data platforms .

/n

- Experience with SQL Server .

/n

- Experience with DuckDB .

/n

- Terraform / Infrastructure-as-Code exposure.

/n

- Docker and containerized data workloads.

/n

- Experience with APIs and structured/semi-structured formats such as JSON, CSV, Parquet, and Apache Arrow .

/n

- Exposure to marketing analytics, marketing measurement, or enterprise consulting environments.

/n

/n

Why This Role Is Different

/n

This isn't simply a role where you'll “build pipelines and move data.”

/n

You'll be responsible for building the data foundation behind modeling, optimization, analytics, customer-facing applications, and AI Agents - with an emphasis on architecture, performance, data quality, governance, reproducibility, and production reliability.

/n

/n

Primary Skills (Mandatory):

/n

Databricks | PySpark | Python | dbt | Azure Dev Ops / CI-CD | PostgreSQL | Advanced SQL | Delta Lake | Medallion Architecture

/n

Good to Have:

/n

MLflow | Lang Chain | AI Agents | SQL Server | DuckDB | Terraform | Docker

📌 Senior Data Engineer (Bengaluru)
🏢 Publicis Global Delivery Pgd
📍 Bengaluru