06 Sep
|
Sparix Global
|
Uttar Pradesh
06 Sep
Sparix Global
Uttar Pradesh
Requirement-2
Please find below JD for the position and need the profiles on priority basis.
Position Overview
The Data Engineer / ADF Administrator is responsible for designing, developing, and administering enterprise data pipelines and platforms within Azure. This role focuses on managing Azure Data Factory (ADF) environments, supporting the Azure Data Lake, and developing scalable data solutions to support analytics and business intelligence.
The role will play a critical part in our data modernization efforts and migration to SAP (BDC, Datasphere, and related platforms) by enabling reliable data integration, transformation, and governance across systems.
Key Responsibilities
ADF Administration & Monitoring
· Manage and administer Azure Data Factory environments across development, testing, and production.
· Monitor pipeline execution, troubleshoot failures, and ensure high availability and performance of data workflows.
· Configure and maintain linked services, datasets, triggers, and integration runtimes.
· Implement access control, security,
and governance standards within ADF.
· Support deployment processes including CI/CD and release management.
Data Pipeline Development
· Design and develop scalable ETL/ELT pipelines using Azure Data Factory.
· Ingest and transform data from multiple sources into the Azure Data Lake.
· Optimize data workflows for performance, reliability, and cost efficiency.
SQL Development & Data Engineering
· Develop and maintain complex SQL queries, stored procedures, and data transformations.
· Optimize performance across Azure SQL and related data platforms.
· Support data modeling and ensure consistency across reporting layers.
Data Lake & Architecture
· Maintain and organize Azure Data Lake structures (raw, curated, and presentation layers).
· Ensure data quality, consistency, and governance across the data platform.
· Support scalable and productive data architecture aligned with business needs.
SAP Integrat
📌 Data Engineer (Uttar Pradesh)
🏢 Sparix Global
📍 Uttar Pradesh