16 Sep
|
Umanist NA
|
Hyderabad
16 Sep
Umanist NA
Hyderabad
Experience:
6+ Years
Location:
Hyderabad / Chennai / Bangalore
Work Mode:
Hybrid – 3 Days Work From Office
Shift:
Day Shift
Notice Period:
0–30 Days / Serving Notice Period
Role Overview
We are looking for an experienced
Senior Data Engineer
with robust hands-on expertise in
Databricks, Lakehouse Architecture, PySpark, Real-Time Data Processing, AI/GenAI solutions, and automated deployment processes
.
The ideal candidate will design, develop, and support scalable batch and streaming data platforms while leveraging modern Databricks capabilities such as
Lakeflow, Unity Catalog, Delta Lake, and AI/GenAI technologies
.
The candidate should be able to work independently, communicate effectively with business and technical stakeholders, and deliver high-quality solutions with minimal supervision.
Mandatory Skills
Candidates Must Have Strong Hands-on Experience In:
- Databricks and modern Lakehouse Architecture
- Integration of enterprise data platforms with AI-driven applications
- Automated deployment and release processes / CI/CD
Technical SkillsDatabricks & Data Engineering
- Strong hands-on experience with Databricks
- Modern Lakehouse Architecture
- PySpark
- Spark Structured Streaming
- SQL
- NoSQL databases
- Delta Lake
- Unity Catalog
- Databricks Workflows and Job Orchestration
- Bronze, Silver, and Gold layer architecture
- Batch and real-time data processing
Databricks Lakeflow
Hands-on Experience With:
- Lakeflow
- Declarative Pipelines
- Lakeflow Connect
- Change Data Capture (CDC)
- Incremental Data Processing
- Data Quality Validation
- Pipeline monitoring and optimization
AI / Generative AI
Experience Building Or Integrating:
- AI Agents
- Copilots
- Generative AI solutions
- Large Language Models (LLMs)
- Retrieval-Augmented Generation (RAG)
- Vector Search
- Prompt Engineering
Candidates should understand how enterprise data platforms can be integrated with AI-powered applications.
Data Governance & Security
Experience With:
- Unity Ca
📌 Senior Data Engineer – Databricks (Hyderabad)
🏢 Umanist NA
📍 Hyderabad