Requirement-2

Please find below JD for the position and need the profiles on priority basis.

Position Overview The Data Engineer / ADF Administrator is responsible for designing, developing, and administering enterprise data pipelines and platforms within Azure. This role focuses on managing Azure Data Factory (ADF) environments, supporting the Azure Data Lake, and developing scalable data solutions to support analytics and business intelligence.

The role will play a critical part in our data modernization efforts and migration to SAP (BDC, Datasphere, and related platforms) by enabling reliable data integration, transformation, and governance across systems.

Key Responsibilities

ADF Administration &

- Monitoring

· Manage and administer Azure Data Factory environments across development, testing, and production.

· Monitor pipeline execution, troubleshoot failures, and ensure high availability and performance of data workflows.

· Configure and maintain linked services, datasets, triggers, and integration runtimes.

· Implement access control, security, and governance standards within ADF.

· Support deployment processes including CI/CD and release management.

Data Pipeline Development

· Design and develop scalable ETL/ELT pipelines using Azure Data Factory.

· Ingest and transform data from multiple sources into the Azure Data Lake.

· Optimize data workflows for performance, reliability, and cost efficiency.

SQL Development &

- Data Engineering

· Develop and maintain complex SQL queries, stored procedures, and data transformations.

· Optimize performance across Azure SQL and related data platforms.

· Support data modeling and ensure consistency across reporting layers.

Data Lake &





- Architecture

· Maintain and organize Azure Data Lake structures (raw, curated, and presentation layers).

· Ensure data quality, consistency, and governance across the data platform.

· Support scalable and efficient data architecture aligned with business needs.

SAP Integration &

- Migration Support

· Support integration with SAP systems including BDC and Datasphere.

· Assist in data migration, mapping, and validation efforts.

· Develop and maintain pipelines connecting Azure and SAP environments.

Collaboration

· Work closely with data analysts, business stakeholders, and IT teams to deliver data solutions.

· Translate business requirements into scalable and productive data pipelines.

· Support ongoing data platform enhancements and modernization initiatives.

Required Qualifications &

- Skills

· Minimum 8–10 years of experience in data engineering, data integration, or related roles.

· Strong experience in Azure Data Factory (ADF) including development and administration.

· Advanced SQL development skills including performance tuning and complex queries.

· Experience with Azure Data Lake and modern data architectures.

· Strong understanding of ETL/ELT processes and data pipeline design.

· Ability to monitor, troubleshoot, and resolve production data issues.

· Strong communication and collaboration skills.

Preferred Qualifications &

- Skills

· Experience with SAP BDC, Datasphere, or related SAP data platforms.

· Familiarity with Azure Synapse, Databricks, or Microsoft Fabric.

· Experience with CI/CD pipelines (Azure DevOps or similar).

· Understanding of data governance, security, and compliance practices.

📌 Data Engineer / ADF Administrator (Uttar Pradesh)
🏢 Sparix Global
📍 Uttar Pradesh