Experience: 10+ Years | Location: Remote / India | Contract Duration: 6 Months
We are looking for a Senior Data Engineer with robust hands-on experience in Azure Databricks, PySpark, Python, and SQL to build and optimize enterprise-scale data pipelines.
Key Skills:
- Azure Databricks, PySpark, Python, SQL
- Azure Data Factory (ADF), ADLS Gen2, Synapse, Event Hubs
- Delta Lake, Lakehouse/Medallion Architecture, ETL/ELT
- Real-time/streaming data pipelines and performance optimization
- GenAI/LLM frameworks such as LangChain, LangGraph, AutoGen, or LlamaIndex
- Experience with automated RCA, data augmentation, anomaly detection, or intelligent remediation
- CI/CD, Azure DevOps, monitoring, and production support
Must Have: 10+ years of Data Engineering experience with strong Azure Databricks and GenAI/LLM integration experience.