Senior Data Engineer – Databricks & AI Solutions

Experience: 6+ Years
Location: Hyderabad / Chennai / Bangalore
Work Mode: Hybrid – 3 Days Work From Office
Shift: Day Shift
Notice Period: 0–30 Days / Serving Notice Period

Role Overview

We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Databricks, Lakehouse Architecture, PySpark, Real-Time Data Processing, AI/GenAI solutions, and automated deployment processes.

The ideal candidate will design, develop, and support scalable batch and streaming data platforms while leveraging modern Databricks capabilities such as Lakeflow, Unity Catalog, Delta Lake, and AI/GenAI technologies.

The candidate should be able to work independently, communicate effectively with business and technical stakeholders, and deliver high-quality solutions with minimal supervision.

Mandatory Skills

Candidates must have solid hands-on experience in:
Databricks and up-to-date Lakehouse Architecture
Integration of enterprise data platforms with AI-driven applications




Automated deployment and release processes / CI/CD

Technical SkillsDatabricks & Data Engineering
Robust hands-on experience with Databricks
Modern Lakehouse Architecture
PySpark
Spark Structured Streaming
SQL
NoSQL databases
Delta Lake
Unity Catalog
Databricks Workflows and Job Orchestration
Bronze, Silver, and Gold layer architecture
Batch and real-time data processing

Databricks Lakeflow

Hands-on experience with:
Lakeflow
Declarative Pipelines
Lakeflow Connect
Change Data Capture (CDC)
Incremental Data Processing
Data Quality Validation
Pipeline monitoring and optimization

AI / Generative AI

Experience building or integrating:
AI Agents
Copilots
Generative AI solutions
Large Language Models (LLMs)
Retrieval-Augmented Generation (RAG)
Vector Search
Prompt Engineering

Candidates should understand how enterprise data platforms can be integrated with AI-powere

📌 Senior Data Engineer – Databricks Bengaluru
🏢 Umanist Staffing
📍 Bengaluru