06 Aug
|
Elabs Infotech
|
Navi Mumbai
06 Aug
Elabs Infotech
Navi Mumbai
Position Overview
We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions on Microsoft Azure. The ideal candidate will have strong expertise in Azure Data Factory, Azure Data Lake, Azure SQL, and Azure Databricks, with experience in building up-to-date data platforms that support analytics and business intelligence.
Key Responsibilities:
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize scalable data processing workflows using Azure Databricks (PySpark/SQL).
- Develop and manage data storage solutions using Azure Data Lake Storage (ADLS Gen2).
- Design, develop, and optimize Azure SQL databases, including writing complex SQL queries, stored procedures, and performance tuning.
- Integrate data from multiple on-premises and cloud-based sources into Azure data platforms.
- Implement data validation,
cleansing, transformation, and quality checks.
- Monitor and troubleshoot data pipelines to ensure high availability and reliability.
Required Skills:
- Strong experience with Azure Data Factory (ADF).
- Hands-on experience with Azure Data Lake Storage (ADLS Gen2).
- Strong knowledge of Azure SQL Database and T-SQL.
- Experience with Azure Databricks and PySpark.
- Proficiency in SQL and data modeling concepts.
- Experience with ETL/ELT design and implementation.
- Understanding of data warehousing concepts and dimensional modeling.
- Knowledge of performance tuning and query optimization.
- Experience with Git, Azure DevOps, and CI/CD pipelines.
- Familiarity with REST APIs and data integration techniques.
📌 Azure Data Engineer (Navi Mumbai)
🏢 Elabs Infotech
📍 Navi Mumbai