Experience: 10+ Years | Location: Remote / India | Contract Duration: 6 Months
We are looking for a Senior Data Engineer with strong hands-on experience in Azure Databricks, PySpark, Python, and SQL to build and optimize enterprise-scale data pipelines.
Key Skills:
Azure Databricks, PySpark, Python, SQL
Azure Data Factory (ADF), ADLS Gen2, Synapse, Event Hubs
Delta Lake, Lakehouse/Medallion Architecture, ETL/ELT
Real-time/streaming data pipelines and performance optimization
GenAI/LLM frameworks such as LangChain, LangGraph, AutoGen, or LlamaIndex
Experience with automated RCA, data augmentation, anomaly detection, or intelligent remediation
CI/CD, Azure DevOps, monitoring, and production support
Must Have: 10+ years of Data Engineering experience with solid Azure Databricks and GenAI/LLM integration experience.