Company:

Celebal Technologies

Experience: 6–10 Years

Location: Yelahanka Bangalore (5 Days from office)

Looking for immediate Joiners

We are looking for a passionate Senior Data Engineer with strong expertise in Azure Databricks and modern data engineering to build scalable, AI-ready data platforms. You'll design high-performance data pipelines, enable real-time and batch data processing, optimize large-scale Spark workloads, and collaborate with business, analytics, and data science teams to deliver enterprise-grade solutions. The role also offers exposure to emerging GenAI and Agentic AI initiatives.

Key Responsibilities

- Design and develop scalable ETL/ELT pipelines using Azure Databricks, PySpark, ADF, and Delta Lake .
- Build Bronze, Silver & Gold Lakehouse architectures for enterprise data platforms.
- Ingest data from APIs, databases, files, Kafka/Event Hub, and cloud storage.
- Optimize Spark jobs using partitioning, caching, AQE, broadcast joins, and Delta optimization.
- Implement CDC, Auto Loader, Schema Evolution,



data quality checks, and performance tuning.
- Ensure secure data governance using Unity Catalog , RBAC, and data masking.
- Collaborate with business stakeholders to deliver analytics-ready datasets and semantic models.
- Support production deployments, monitoring, troubleshooting, and continuous improvements.

About the Role

- Azure Databricks, PySpark, Spark SQL
- Azure Data Factory (ADF), ADLS Gen2
- Delta Lake, Unity Catalog
- SQL, ETL/ELT, Data Modeling
- Kafka/Event Hub, Structured Streaming
- Performance Optimization & Cost Optimization
- Azure DevOps, Git
- Robust analytical, communication, and stakeholder management skills

Good to have
- Databricks AI/BI, Genie
- Exposure to LLMs, RAG, Agentic AI, or AI Assistants
- Experience in Retail, FMCG, Supply Chain, Manufacturing, or Insurance domains

pls apply at [email protected]

📌 Senior Data Engineer (Jaipur)
🏢 Celebal Technologies
📍 Jaipur