Senior Data Engineer – Azure Databricks & Gen AIExperience: 10+ Years | Location: Remote / India | Contract Duration: 6 Months We are looking for a Senior Data Engineer with solid hands-on experience in Azure Databricks, Py Spark, Python, and SQL to build and optimize enterprise-scale data pipelines.
Key Skills: Azure Databricks, Py Spark, Python, SQLAzure Data Factory (ADF), ADLS Gen2, Synapse, Event Hubs Delta Lake, Lakehouse/Medallion Architecture, ETL/ELTReal-time/streaming data pipelines and performance optimization Gen AI/LLM frameworks such as Lang Chain, Lang Graph, Auto Gen, or Llama Index Experience with automated RCA, data augmentation, anomaly detection, or intelligent remediation CI/CD, Azure Dev Ops, monitoring, and production support Must Have: 10+ years of Data Engineering experience with strong Azure Databricks and Gen AI/LLM integration experience.