Key Responsibilities:
- Design and develop end-to-end data pipelines using Azure Data Factory and Azure Databricks
- Integrate data from various sources including SQL Server, Azure Data Lake, Blob Storage, and third-party APIs
- Build and optimize ETL/ELT workflows using PySpark/Scala in Azure Databricks
- Develop and maintain data models and datasets for analytics and reporting
- Work with data analysts and business stakeholders to understand requirements and translate them into technical solutions
- Monitor pipeline performance and implement logging, alerting, and recovery strategies
- Ensure data quality, security, and governance across all workflows
- Participate in code reviews, technical documentation, and agile ceremonies
- Collaborate with cloud architects and DevOps teams to automate deployments (CI/CD)

Disclaimer: This job description has been sourced from a public domain and may have been modified by Naukri.com to improve clarity for our users. We encourage job seekers to verify all details directly with the employer via their official channels before applying.

📌 ADF Professional (Bengaluru)
🏢 Diverse Lynx
📍 Bengaluru