Job DescriptionWe are hiring for a Data Engineer :
n

nExperience: 5 to 10 years .
nLocation: Pune
n

n
- n
- 5-10 years of data engineering experience, including 3+ years of hands-on Databricks experience.n
- Hands-on experience with Azure Databricks, including notebooks, workflows, jobs, and pipeline development.n
- Strong proficiency in PySpark, Spark SQL, Python, and SQL.n
- Experience with Delta Lake, Delta Live Tables (DLT), Auto Loader, Lakeflow, and Structured Streaming.n
- Strong understanding of Medallion Lakehouse architecture, ETL/ELT pipeline engineering, data ingestion, data quality, monitoring, logging, and performance optimization.n
- Experience with Unity Catalog, RBAC, data governance, lineage, and access control.n




- Ability to optimize Spark workloads using partitioning, caching, cluster sizing, and query tuning.n
- Positive understanding of security, identity and access management, compliance, and governance.n
- Experience with Azure Data Factory (ADF), Integration Runtime, ADLS Gen2, Airflow, Azure SQL, Key Vault, Logic Apps, Event Grid, Azure VMs, Bicep, VNet, and Private Endpoints.n
- Experience with Azure DevOps, Git, CI/CD, and environment management.n
- Good communication and collaboration skills.n
- Good-to-have exposure to GenAI workloads on Databricks.n

📌 Azure Data Engineer (Vasanthanagar)
🏢 Tata Consultancy Services
📍 Vasanthanagar