Azure Data Engineer

Location: Chennai Work From Office (Onsite)
Experience: 7 to 10 Years
Working Hours: Rotational UK / US Shift

- UK Shift: 2:00 PM 11:00 PM IST
- US Shift: 5:30 PM 2:30 AM IST

Position Overview

We are looking for an experienced Azure Data Engineer with strong hands-on expertise in Azure Data Factory (ADF), Microsoft Fabric, and PySpark to join our data engineering team on a contract basis in Chennai.

The candidate will be responsible for developing scalable data pipelines, implementing modern data architectures, and supporting data integration and transformation workloads across the Azure ecosystem.

Mandatory Skills

- 7+ years of overall IT experience
- 5+ years of hands-on Data Engineering experience
- Azure Data Factory (ADF) Mandatory
- Microsoft Fabric Mandatory
- PySpark Mandatory
- Strong understanding of Medallion Data Architecture (Bronze, Silver, Gold)
- Experience with CI/CD pipelines and deployment automation
- Strong SQL and data transformation experience
- Experience developing and optimizing ETL/ELT data pipelines




- Good understanding of Azure data engineering best practices

Key Responsibilities

- Design, develop, and maintain scalable Azure data pipelines using ADF and Microsoft Fabric.
- Develop data transformation and processing solutions using PySpark.
- Implement Bronze, Silver, and Gold layers using the Medallion Architecture.
- Build and manage data ingestion, transformation, and integration workflows.
- Implement and maintain CI/CD pipelines for data engineering deployments.
- Troubleshoot pipeline failures, performance issues, and data quality problems.
- Collaborate with data architects, developers, analysts, and business stakeholders.
- Follow best practices for security, scalability, performance, and maintainability.

Candidate Requirements

- Solid hands-on experience with ADF + Microsoft Fabric + PySpark.
- Must be comfortable working onsite from Chennai.
- Must be willing to work in rotational UK and US shifts.
- Strong communication and problem-solving skills.

📌 Azure Data Engineer (Chennai)
🏢 ThreatXIntel
📍 Chennai