Role: Senior Data Engineer – Databricks

Experience: 5+ Years

Work Type: C2H

Location: Hyderabad, Pune, Gurgaon

Roles

- Design and develop scalable batch and real-time data engineering solutions .
- Build and maintain up-to-date Databricks Lakehouse platforms .
- Develop AI/GenAI-powered data solutions using enterprise data.
- Drive data governance, security, quality, and CI/CD practices.
- Work independently and lead technical initiatives from design to production.

Responsibilities

- Develop data pipelines using Databricks, PySpark, Spark Structured Streaming, and SQL .
- Build Bronze, Silver & Gold Lakehouse architecture using Delta Lake.
- Develop Databricks Lakeflow pipelines, CDC, incremental processing, and data quality validations.
- Implement Unity Catalog governance, RBAC, masking, lineage, and audit logging.
- Integrate enterprise and external data sources into Databricks.




- Build AI Agents, Copilots, RAG and GenAI solutions using LLMs and Vector Search.
- Implement CI/CD using Git, Databricks Repos and Asset Bundles (DABs) .
- Monitor, troubleshoot, and optimize pipeline performance and reliability.

Mandatory:

- Databricks
- PySpark
- Spark Structured Streaming
- SQL
- Delta Lake
- Lakehouse Architecture
- Unity Catalog
- Databricks Workflows
- Lakeflow & CDC
- Data Governance & Security
- LLMs
- RAG

Apply: [email protected]

Contact: +91 86680 72276

#Hiring #DataEngineer #SeniorDataEngineer #Databricks #PySpark #Lakehouse #DeltaLake #UnityCatalog #Lakeflow #SparkStreaming #Azure #GenAI #LLM #RAG #DataEngineering #C2H #TechJobs

📌 Data Engineer (Hyderabad)
🏢 LogFix SCM Solutions
📍 Hyderabad