Azure Data Engineer

Location: Chennai Work From Office (Onsite)

Experience: 7 to 10 Years

Working Hours: Rotational UK / US Shift
UK Shift: 2:00 PM 11:00 PM IST
US Shift: 5:30 PM 2:30 AM IST

Position Overview We are looking for an experienced Azure Data Engineer with strong hands-on expertise in Azure Data Factory (ADF), Microsoft Fabric, and PySpark to join our data engineering team on a contract basis in Chennai.

The candidate will be responsible for developing scalable data pipelines, implementing up-to-date data architectures, and supporting data integration and transformation workloads across the Azure ecosystem.

Mandatory Skills
7+ years of overall IT experience
5+ years of hands-on Data Engineering experience
Azure Data Factory (ADF) Mandatory
Microsoft Fabric Mandatory
PySpark Mandatory
Strong understanding of Medallion Data Architecture (Bronze, Silver, Gold)
Experience with CI/CD pipelines and deployment automation
Strong SQL and data transformation experience
Experience developing and optimizing ETL/ELT data pipelines




Valuable understanding of Azure data engineering best practices

Key Responsibilities
Design, develop, and maintain scalable Azure data pipelines using ADF and Microsoft Fabric.
Develop data transformation and processing solutions using PySpark.
Implement Bronze, Silver, and Gold layers using the Medallion Architecture.
Build and manage data ingestion, transformation, and integration workflows.
Implement and maintain CI/CD pipelines for data engineering deployments.
Troubleshoot pipeline failures, performance issues, and data quality problems.
Collaborate with data architects, developers, analysts, and business stakeholders.
Follow best practices for security, scalability, performance, and maintainability.

Candidate Requirements
Robust hands-on experience with ADF + Microsoft Fabric + PySpark.
Must be comfortable working onsite from Chennai.
Must be willing to work in rotational UK and US shifts.
Strong communication and problem-solving skills.

📌 Azure Data Engineer Chennai
🏢 Threatxintel Cyber Labs
📍 Chennai