We are looking for an experienced Azure Data Engineer with 6 to 10 years of experience in designing, developing, and maintaining enterprise-scale data solutions on Microsoft Azure. The ideal candidate should have solid expertise in Azure data services, ETL/ELT development, data warehousing, big data technologies, and cloud-based data engineering practices.
Preferred candidate profile
Must Have Skills
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Data Lake Storage (ADLS Gen2)
- Azure Synapse Analytics
- Azure SQL Database
- PySpark
- Python
- SQL
- Azure DevOps / CI-CD
- Data Modeling
- Power BI (Good to Have)
- Delta Lake
- Git Version Control
Roles & Responsibilities
- Design, develop, and implement scalable data pipelines using Azure Data Factory and Databricks.
- Build and optimize ETL/ELT processes for structured and unstructured data.
- Develop data ingestion frameworks from multiple source systems into Azure Data Lake.
- Create and maintain data models, data warehouses, and data marts.
- Work with business stakeholders to understand data requirements and translate them into technical solutions.
- Optimize Spark jobs and SQL queries for performance and scalability.
- Implement data quality, governance, security, and monitoring practices.
- Collaborate with Data Scientists, Architects, and BI teams for end-to-end data solutions.
- Automate deployment processes using Azure DevOps and CI/CD pipelines.
- Troubleshoot production issues and provide timely resolutions.
- Ensure compliance with security and governance standards.