12 Aug
|
Weekday AI
|
Bengaluru
12 Aug
Weekday AI
Bengaluru
This role is for one of Weekday’s clients
Salary range: Rs 400000 - Rs 2600000 (ie INR 4 - 26 LPA)
Min Experience: 6+ years
Location: Bengaluru, Hyderabad, Chennai, Tamil Nadu, India
JobType: full-time
We are looking for an experienced Azure Data Engineer with 6–15 years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions on Microsoft Azure. The ideal candidate will have robust expertise in Azure Data Factory, Azure Databricks, PySpark/Scala, Azure SQL, ADLS Gen2, and CI/CD pipelines.
You will be responsible for building robust data pipelines, developing data transformation workflows, integrating cloud-based data services, and ensuring data platforms are secure, scalable, reliable, and optimized for performance.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory.
Build and optimize large-scale data processing solutions using Azure Databricks and PySpark/Scala.
Develop data ingestion and transformation workflows across structured and unstructured data sources.
Work extensively with Azure Data Lake Storage Gen2 (ADLS Gen2) for data storage, organization, and processing.
Develop and optimize solutions using Azure SQL, T-SQL, and Stored Procedures.
Design and implement integrations and event-driven workflows using Azure Logic Apps.
Implement secure access and credential management using Azure Key Vault.
Create and maintain CI/CD pipelines for data engineering applications, notebooks, workflows, and infrastructure.
Monitor data pipelines and troubleshoot performance, reliability, and production issues.
Collaborate with data architects, software engineers, analysts, and business stakeholders to translate requirements into scalable technical solutions.
Follow best practices for data security, governance, performance optimization, and cloud architecture.
Participate in code reviews, technical documentation, deployment planning, and production support activities.
Must-H
📌 Azure Data Engineer (Bengaluru)
🏢 Weekday AI
📍 Bengaluru