Senior Data Engineer – Databricks & AI Solutions

Experience: 6+ Years
Location: Hyderabad / Chennai / Bangalore
Work Mode: Hybrid – 3 Days Work From Office
Shift: Day Shift
Notice Period: 0–30 Days / Serving Notice Period

Role Overview

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Databricks, Lakehouse Architecture, PySpark, Real-Time Data Processing, AI/GenAI solutions, and automated deployment processes.

The ideal candidate will design, develop, and support scalable batch and streaming data platforms while leveraging modern Databricks capabilities such as Lakeflow, Unity Catalog, Delta Lake, and AI/GenAI technologies.

The candidate should be able to work independently, communicate effectively with business and technical stakeholders, and deliver high-quality solutions with minimal supervision.

Mandatory Skills

Candidates must have solid hands-on experience in:

-
Databricks and modern Lakehouse Architecture

-
Integration of enterprise data platforms with AI-driven applications

-
Automated deployment and release processes / CI/CD





Technical SkillsDatabricks & Data Engineering

-
Strong hands-on experience with Databricks

-
Modern Lakehouse Architecture

-
PySpark

-
Spark Structured Streaming

-
SQL

-
NoSQL databases

-
Delta Lake

-
Unity Catalog

-
Databricks Workflows and Job Orchestration

-
Bronze, Silver, and Gold layer architecture

-
Batch and real-time data processing

Databricks Lakeflow

Hands-on experience with:

-
Lakeflow

-
Declarative Pipelines

-
Lakeflow Connect

-
Change Data Capture (CDC)

-
Incremental Data Processing

-
Data Quality Validation

-
Pipeline monitoring and optimization

AI / Generative AI

Experience building or integrating:

-
AI Agents

-
Copilots

-
Generative AI solutions

-
Large Language Models (LLMs)

-
Retrieval-Augmented Generation (RAG)

-
Vector Search

-
Prompt Engineering

Candidates should understand how enterprise data platforms can be integrated with AI-powere

📌 Senior Data Engineer – Databricks (Bengaluru)
🏢 Umanist Staffing
📍 Bengaluru