13 Aug
|
Advance Career Solutions
|
Bengaluru
13 Aug
Advance Career Solutions
Bengaluru
Job Title: Azure Data Engineer 8+ Years
Experience: 8+ Years
Location: Pan India
Notice Period: Immediate to 30 Days only
Job Summary
We are looking for an experienced Azure Data Engineer with 8+ years of experience in designing, developing, and maintaining scalable data solutions on Microsoft Azure. The ideal candidate should have strong expertise in Azure Data Factory, Azure Databricks, PySpark, SQL, Azure Data Lake Storage, and data warehousing.
The candidate will be responsible for building robust data pipelines, implementing ETL/ELT processes, optimizing data platforms, and working closely with data architects, analysts, and business stakeholders.
Key Responsibilities
- Design, develop, and maintain scalable and reliable data pipelines on Microsoft Azure.
- Develop and optimize ETL/ELT workflows using Azure Data Factory (ADF).
- Build data processing solutions using Azure Databricks and PySpark.
- Develop complex SQL queries, stored procedures, views, and performance-optimized data solutions.
- Work with Azure Data Lake Storage Gen2 (ADLS)
for large-scale data ingestion and processing.
- Implement data integration from various sources including databases, APIs, files, and cloud applications.
- Design and implement data warehouse and data lake solutions.
- Perform data transformation, cleansing, validation, and quality checks.
- Implement incremental data loads, CDC, partitioning, and performance optimization.
- Monitor, troubleshoot, and optimize data pipelines and production workflows.
- Implement appropriate security, access control, and data governance practices.
- Collaborate with Data Architects, Data Scientists, BI Developers, and business teams.
- Participate in code reviews, technical design discussions, and production support.
- Follow best practices for CI/CD, version control, testing, and deployment of data engineering solutions.
Required Technical Skills
- 8+ years of experience in Data Engineering / ETL development
- Solid hands-on experienc
📌 Azure Data Engineer (Bengaluru)
🏢 Advance Career Solutions
📍 Bengaluru