Azure Data Engineer Job Description

Job Summary

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions on the Microsoft Azure cloud platform. The ideal candidate will build robust data pipelines, optimize data processing workflows, and support analytics and business intelligence initiatives.

Key Responsibilities

- Design, develop, and maintain ETL/ELT data pipelines using Azure data services.
- Develop and manage data integration solutions using Azure Data Factory (ADF).
- Build and optimize data lakes and data warehouses using Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.
- Develop data transformation workflows using Azure Databricks and Apache Spark.
- Create scalable data models to support reporting and analytics.
- Implement data quality, validation, governance, and security best practices.
- Optimize SQL queries and database performance.
- Monitor and troubleshoot data pipelines and production issues.
- Collaborate with data analysts, data scientists, business stakeholders, and application teams.
- Implement CI/CD pipelines using Azure DevOps or GitHub Actions.
- Ensure compliance with data security and privacy standards.

Required Skills

- Strong experience with Microsoft Azure cloud services.
- Hands-on experience with Azure Data Factory (ADF).
- Experience with Azure Databricks and Apache Spark.




- Knowledge of Azure Synapse Analytics.
- Experience with Azure Data Lake Storage (ADLS).
- Robust SQL programming and query optimization skills.
- Proficiency in Python, PySpark, or Scala.
- Experience with ETL/ELT development.
- Knowledge of data warehousing concepts and dimensional modeling.
- Familiarity with Azure DevOps, Git, and CI/CD pipelines.
- Understanding of data governance, security, and monitoring.

Preferred Qualifications

- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3–8+ years of experience in data engineering.
- Microsoft Azure certifications such as Azure Data Engineer Associate are preferred.
- Experience with Power BI for reporting and dashboard integration.
- Knowledge of Delta Lake, streaming data, and real-time data processing is an advantage.

Technical Skills

- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS Gen2)
- Azure SQL Database
- SQL Server
- Python
- PySpark
- SQL
- Apache Spark
- Azure DevOps
- Git
- Power BI
- REST APIs
- Data Warehousing
- ETL/ELT
- CI/CD

Soft Skills

- Strong analytical and problem-solving abilities
- Excellent communication and collaboration skills
- Ability to work in Agile/Scrum environments
- Attention to detail
- Time management and organizational skills

📌 Azure Data Engineer (Karnataka)
🏢 Everforth Apex Systems
📍 Karnataka