06 Sep
|
TalentOla
|
Bengaluru
06 Sep
TalentOla
Bengaluru
Job Title: Azure Data Engineer
Experience: 4–10 Years
Location: [Add Location]
Employment Type: Full-time
Job Overview
We are seeking a skilled Azure Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Data Factory, Databricks, Synapse, and contemporary data engineering practices.
Key Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory
- Build scalable data solutions using Azure Databricks (PySpark), Azure Synapse Analytics, ADLS Gen2
- Implement data ingestion from multiple sources (SQL/NoSQL/On-prem/cloud)
- Develop and optimize Spark workloads and notebook-based transformations
- Work with stakeholders to understand data requirements and create technical solutions
- Ensure data quality, reliability, security, and governance across all platforms
- Implement CI/CD pipelines for data projects using Azure DevOps/Git
- Optimize performance of data flows, storage, and compute resources
- Support production pipelines and resolve issues proactively
Must-Have Skills
- Strong hands-on experience with Azure Data Factory (ADF)
- Expertise in Azure Databricks / PySpark
- Experience with Azure Synapse or Azure SQL Data Warehouse
- Proficiency in SQL (advanced queries, performance tuning)
- Understanding of data lake architecture (Bronze/Silver/Gold layers)
- Experience with Azure Storage (ADLS Gen2), Delta Lake
- Knowledge of CI/CD using Azure DevOps / Git
- Strong understanding of data modeling & ETL/ELT patterns
Good to Have
- Experience with Azure Event Hub, Azure Stream Analytics, Kafka
- Knowledge of Power BI
- Experience with Python for data processing
- Familiarity with data governance frameworks (Purview)
- Azure certifications (e.g., DP-203)
-
📌 AWS/Azure Data Engineer (Bengaluru)
🏢 TalentOla
📍 Bengaluru