06 Aug
|
Orcapod Consulting Services
|
Pune
06 Aug
Orcapod Consulting Services
Pune
Job Title: Microsoft Azure Data Engineer
Location: Pune
Experience: 610 Years
Employment Type: Contract
Job Summary
We are looking for an experienced Microsoft Azure Data Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The ideal candidate should have strong expertise in building ETL pipelines, Azure Data Factory, Azure Databricks, Azure Data Lake, Python/Scala, SQL, and contemporary data warehousing concepts. The candidate will work closely with business stakeholders, data scientists, and analysts to deliver high-quality data solutions that support analytics and machine learning initiatives.
Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Build scalable data processing solutions using Azure Databricks and PySpark/Spark.
- Develop and maintain data lakes using Azure Data Lake Storage (ADLS Gen2).
- Design and optimize data warehouse solutions using dimensional modeling techniques.
- Develop data integration solutions from multiple structured and unstructured data sources.
- Write optimized SQL queries, stored procedures,
and database objects.
- Collaborate with data scientists and business analysts to deliver analytics-ready datasets.
- Implement CI/CD pipelines using Azure DevOps and Git.
- Monitor, troubleshoot, and optimize Azure data pipelines for performance and reliability.
- Participate in Agile ceremonies, code reviews, and technical discussions.
Required Skills
- 6+ years of experience in Azure Data Engineering.
- Hands-on experience with Azure Data Factory (ADF).
- Strong experience with Azure Databricks and Apache Spark/PySpark.
- Experience with Azure Data Lake Storage (ADLS Gen2).
- Strong programming skills in Python (Scala is an added advantage).
- Advanced SQL knowledge and experience with relational databases such as SQL Server, PostgreSQL, or Oracle.
- Experience with ETL development and data warehousing concepts.
- Hands-on experience with Azure DevOps, Git, and CI/CD pipelines.
- Experience working with REST APIs for data integration.
- Good understanding of Agile/Scrum methodologies.
📌 Microsoft Azure Data services (Pune)
🏢 Orcapod Consulting Services
📍 Pune