22 Oct
|
Ignitho
|
Chennai
Job Description: Senior Azure Data Engineer
Role Summary
We are looking for a Senior Azure Data Engineer with strong hands-on experience in building, optimizing, and maintaining scalable data pipelines and cloud-based data platforms using Microsoft Azure. The ideal candidate should have expertise in data engineering, Lakehouse architecture, and working with distributed teams to deliver high-quality data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines.
- Build and optimize data processing solutions using Azure Databricks, PySpark, SQL, and Delta Lake.
- Work with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Microsoft Fabric.
- Implement Lakehouse and Medallion architectures for batch and real-time data processing.
- Ensure data quality, governance, security, and compliance across data platforms.
- Optimize pipeline performance, troubleshoot issues, and manage data integration workflows.
- Implement CI/CD pipelines using Azure DevOps and Infrastructure as Code.
- Collaborate with architects, business stakeholders,
and distributed engineering teams.
Required Skills & Experience
- 7+ years of experience in data engineering, with strong hands-on experience in Azure data services.
- Strong expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics.
- Proficiency in SQL, Python/PySpark, Spark performance tuning, and Delta Lake.
- Experience with Lakehouse, Medallion architecture, and data modeling.
- Knowledge of data governance, security, metadata management, and Azure DevOps CI/CD.
- Working knowledge of Microsoft Fabric is preferred.
- Strong problem-solving, communication, and collaboration skills.
Preferred Qualifications
- Microsoft Azure Data Engineer Associate or equivalent certification.
- Experience with large-scale data migrations and enterprise data platforms.
- Exposure to Life Sciences or Pharma domain and Veeva CTMS is an advantage.
- Familiarity with AI/ML data pipelines and up-to-date cloud data architectures.
📌 Azure Data Engineer (Chennai)
🏢 Ignitho
📍 Chennai