31 Aug
|
Publicis Global Delivery Pgd
|
Mumbai
31 Aug
Publicis Global Delivery Pgd
Mumbai
Remote: Hybrid
Senior Data Engineer - Databricks | PySpark | dbt | Lakehouse Engineering⚠️ This is NOT a typical Data Engineering position.We are looking for ahands-on Senior Data Engineer with strong, production-grade Databricks experience- someone who has actually built and optimizedLakehouse/Medallion architectures, PySpark & dbt pipelines, PostgreSQL data layers, and CI/CD workflows , rather than someone with only surface-level exposure to these technologies.⚠️ If Databricks is not a core part of your recent hands-on experience, this role may not be the right fit.Job Title:Senior Data EngineerSpecialization:Data Engineering | Databricks | Lakehouse | Data Platforms | AI-Ready DataExperience:5+ YearsLocation:BNG | HYD | PUN | MUM | GGNWork Model:HybridWhat We're Looking ForMandatory-Robust hands-on experience required:•Databricks– with practical experience building production data platforms and Lakehouse architectures.•PySpark– strong production experience working with non-trivial data volumes.•Python– advanced programming and data engineering experience.•dbt– hands-on experience with staging, transformations, incremental models, testing, and documentation.•CI/CD – Azure DevOps– experience deploying and managing data assets through CI/CD pipelines.•PostgreSQL– database design, schema management, query optimization,
and performance tuning.• Strong understanding ofMedallion Architecture and Delta Lake .• Advanced SQL and experience working with large-scale datasets.Good to Have•MLflowand experience supporting ML/data science workflows.•LangChainor similar AI/Agent frameworks.• Exposure toAI Agents / AI-ready data platforms .• Experience withSQL Server .• Experience withDuckDB .• Terraform / Infrastructure-as-Code exposure.• Docker and containerized data workloads.• Experience with APIs and structured/semi-structured formats such asJSON, CSV, Parquet, and Apache Arrow .• Exposure to marketing analytics, marketing measurement, or enterprise consulting environments.Why This Role Is DifferentThis isn't simply a role where you'll“build pipelines and move data.”You'll be responsible for building thedata foundation behind modeling, optimization, analytics, customer-facing applications, and AI Agents- with an emphasis on architecture, performance, data quality, governance, reproducibility, and production reliability.Primary Skills (Mandatory):Databricks | PySpark | Python | dbt | Azure DevOps / CI-CD | PostgreSQL | Advanced SQL | Delta Lake | Medallion ArchitectureGood to Have:MLflow | LangChain | AI Agents | SQL Server | DuckDB | Terraform | Docker
📌 Senior Data Engineer (Mumbai)
🏢 Publicis Global Delivery Pgd
📍 Mumbai