15 Sep
|
Threatxintel Cyber Labs
|
Chennai
15 Sep
Threatxintel Cyber Labs
Chennai
Azure Data Factory (ADF) Developer
Position Type: Contract
Experience Level: 5+ Years
Position Overview
We are seeking an experienced Azure Data Factory (ADF) Developer with 5+ years of hands-on data engineering experience to join our growing data platform team. In this role, you will be responsible for designing, building, and optimizing scalable ETL/ELT pipelines in Microsoft Azure, moving and transforming data from diverse sources into enterprise data stores.
The ideal candidate possesses strong technical expertise in cloud data architecture, excellent problem-solving skills, and exceptional written and verbal communication abilities to collaborate effectively with cross-functional technical teams, business stakeholders, and client partners.
Key Responsibilities
- Pipeline Architecture & Development: Design, build, deploy, and maintain end-to-end scalable data pipelines using Azure Data Factory (ADF) (Data Flows, Mapping Data Flows, Pipelines, Triggers, and Linked Services).
- Data Integration: Ingest data from various structured, semi-structured, and unstructured sources (APIs, Azure Blob/ADLS Gen2, SQL Databases, REST endpoints).
- Automation & DevOps: Maintain CI/CD pipelines using Azure DevOps for automated code deployment, testing, and lifecycle management of data assets.
- Monitoring & Support: Set up robust logging, alerting, and failure recovery mechanisms using Azure Monitor / Log Analytics.
- Collaboration & Stakeholder Management:
Translate business requirements into clear technical specifications, communicate project statuses, and present architectural solutions clearly to non-technical stakeholders.
Key Qualifications
Required Technical Skills
- 5+ years of hands-on experience in Data Engineering / Data Integration roles.
- 3+ years of dedicated experience building and deploying batch & real-time pipelines using Azure Data Factory.
- Deep proficiency in Advanced SQL (Stored procedures, performance tuning, indexing, complex joins, analytical window functions).
- Familiarity with data modeling concepts (Star Schema, Snowflake Schema, Data Warehousing fundamentals).
Communication & Interpersonal Skills (Essential)
- Outstanding verbal and written English communication skills with the ability to explain technical concepts to non-technical audiences clearly.
- Active listener with solid documentation habits (writing clean technical specs, pipeline diagrams, and runbooks).
Additional Skills (Value Add)
- Snowflake Expertise (Big Plus): Hands-on experience with Snowflake cloud data warehouse (SnowSQL, Snowpipe, Tasks, Streams, Stages, virtual warehouse optimization, and integrating ADF with Snowflake).
- Experience with Azure Databricks / PySpark or Python for complex data transformations.
- Certifications such as Microsoft Certified: Azure Data Engineer Associate (DP-203)
📌 Azure Data Factory Developer(Contract) (Chennai)
🏢 Threatxintel Cyber Labs
📍 Chennai