08 Nov
|
Technocrats Domain
|
India
08 Nov
Technocrats Domain
India
Technocrats Domain Inc. (TCD) is seeking a hands-on Senior Azure Data Factory (ADF) Developer to build and support production data pipelines. This role requires strong SQL skills and the ability to own integrations from source analysis and data mapping through deployment, monitoring, and troubleshooting.
Key Responsibilities
- Design, build, and maintain ADF pipelines that ingest data from databases, APIs, and files into Azure SQL, Azure Data Lake Storage, or other target platforms.
- Build reusable, parameterized pipelines that support full and incremental loads, scheduling, and dependency management.
- Write and optimize complex SQL queries and stored procedures for transformations, data validation, and source-to-target reconciliation.
- Implement logging, alerts, retries, and restart procedures so failed loads can be recovered without creating duplicate records.
- Diagnose production issues and improve pipeline throughput, SQL performance, and data quality.
- Partner with business and technical teams to document data mappings, test pipeline changes, and deploy them across environments.
Required Qualifications
- 5+ years of experience in data engineering, ETL/ELT, or data integration, including hands-on experience building and supporting production ADF pipelines.
- Solid SQL skills, including joins, CTEs, window functions, stored procedures, and query performance tuning using execution plans.
- Hands-on experience with ADF activities, linked services, datasets, triggers, and integration runtimes.
- Experience with incremental load patterns, data reconciliation, and troubleshooting failures across source and target systems.
- Ability to independently investigate production issues and communicate findings and fixes clearly.
Preferred Qualifications
- Experience with Azure DevOps or Git-based CI/CD for ADF deployments.
- Experience connecting ADF to on-premises data sources using a self-hosted integration runtime.
- Familiarity with Azure Key Vault, managed identities, and Azure Monitor.
- Nice to have any knowledge of Databricks
📌 Senior Azure Data Factory Developer (India)
🏢 Technocrats Domain
📍 India