Job Title: Sr/Lead Azure Data Engineer
Experience Level: 715 Years
Employment Type: Full-Time
Location: Chennai/Gurugram
Shift time : 1 to 10pm -5days office in week
Job Summary:
We are looking for a skilled Data Engineer with strong expertise in Pyspark programming and hands-on experience with Azure Data Services, including Synapse, Data Lake, App Logic, and DevOps integration. The ideal candidate will have a robust understanding of data warehousing, MS SQL/PLSQL, and building scalable data pipelines and solutions on the cloud.
Key Responsibilities:
- Develop and optimize scalable data pipelines using Pyspark and Azure Data Services.
- Design and implement end-to-end data solutions using Azure Synapse Analytics, Data Lake, and Azure Logic Apps.
- Build and maintain efficient data models, transformations, and workflows supporting business intelligence and analytics.
- Integrate CI/CD pipelines with Azure DevOps for automated deployments and version control.
- Work with MS SQL Server, T-SQL, and PL/SQL to manage structured data in a data warehouse environment.
- Implement best practices for data ingestion, transformation, quality, and security.
- Collaborate with data scientists, analysts,
and business users to understand data needs and deliver reliable solutions.
- Monitor performance and troubleshoot issues across the data platform infrastructure.
Required Skills and Qualifications:
- Strong proficiency in Pyspark for data engineering tasks (ETL/ELT, automation, data processing).
- Solid experience with Azure Data Services:
- Azure Synapse Analytics
- Azure Data Lake Storage (Gen2)
- Azure Logic Apps
- Azure DevOps
- Good understanding of data warehouse design concepts (star/snowflake schema, fact/dimension tables).
- Advanced skills in SQL and PL/SQL for writing queries, stored procedures, and optimizing performance.
- Experience integrating data from multiple structured and unstructured sources.
- Familiarity with data governance, security, and compliance in a cloud environment.
Preferred Qualifications:
- Microsoft Azure certifications (e.g., DP-203: Azure Data Engineer Associate).
- Experience with version control systems like Git.
- Knowledge of data orchestration tools like Azure Data Factory is a plus.
- Exposure to Agile/Scrum methodologies.
Rgds
Yakesh
📌 Lead Data Engineer (Delhi)
🏢 Incedo
📍 Delhi