Lead Data Engineer – SAP Ariba Integration | Azure Databricks (India)

Lead Data Engineer – SAP Ariba Integration | Azure Databricks (India)

22 Aug
|
K9V Tech & AI
|
India

22 Aug

K9V Tech & AI

India

K9V Tech is hiring a Lead Data Engineer – SAP Ariba Integration Stream Lead for an enterprise Azure Databricks Lakehouse programme.

The role will focus on replacing existing file- and bot-based ingestion with a production-grade API-driven data pipeline and bringing supplier, sourcing and negotiation data from SAP Ariba into the enterprise Lakehouse.

The ideal candidate should have strong hands-on experience with SAP Ariba APIs, Python, PySpark, Databricks, REST APIs, Delta Lake and production data pipelines.

Key Responsibilities

- Lead the SAP Ariba integration stream.
- Build and own API-based ingestion pipelines from SAP Ariba.
- Replace legacy file/bot-based extraction with scalable API-driven ingestion.
- Run parallel operations against existing feeds and reconcile results.
- Lead cutover activities without downstream disruption.
- Work with business users to confirm data objects, grain and required attributes.
- Build Bronze and Silver layers for SAP Ariba data.
- Conform supplier/vendor information with the ERP master data.
- Develop historical data backfill pipelines.
- Implement daily incremental ingestion.
- Build Gold data products for BI consumption.
- Create data dictionaries and schema contracts for downstream AI/ML teams.
- Establish data-quality rules and monitoring.
- Implement schema-drift detection.
- Own reconciliation processes and data-quality outcomes.

Mandatory Skills

- 7–12 years of Data Engineering experience.
- Strong hands-on experience with Azure Databricks.
- Hands-on production experience with SAP Ariba APIs.
- Experience with:
- SAP Ariba Operational Reporting API
- SAP API Business Hub
- Functional knowledge of SAP Ariba.
- Experience with Sourcing and/or Supplier Lifecycle & Performance (SLP) data objects.




- Advanced Python programming.
- Robust PySpark experience.
- Experience developing production pipelines in Databricks.
- Strong REST API integration experience.
- Experience with:
- OAuth2
- API-key authentication
- Pagination
- API throttling
- Retry mechanisms
- Incremental watermarking
- Experience modelling semi-structured JSON responses into tabular/conformed schemas.
- Experience designing idempotent and replayable pipelines.
- Experience with schema-drift detection.
- Strong experience with Databricks Workflows.
- Strong experience with Delta Lake.
- Experience with Azure Key Vault or equivalent secrets-management solutions.
- Experience with cross-system master-data conformance.
- Strong data-quality, monitoring and reconciliation experience.

Good to Have

- Historical bulk-load approaches for SaaS sources.
- Data Transfer Tool / SFTP extraction experience.
- SAP Ariba CIG concepts.
- UiPath or other RPA exposure.
- SaaS-to-Lakehouse integration experience.
- SaaS-to-warehouse integration experience.
- Experience creating data dictionaries and schema contracts for AI/ML consumers.
- SAP ECC vendor-master familiarity.

Ideal Candidate

The ideal candidate is a hands-on Lead Data Engineer who can independently design, develop and lead production-grade SAP Ariba integrations on Azure Databricks.

You should be comfortable working across APIs, data engineering, data modelling, orchestration, data quality and enterprise master-data integration.

Application

Interested candidates can share their updated CV at:

[email protected] & [email protected]

Please mention "Lead Data Engineer – SAP Ariba Integration" in the email subject line.

Pay: ₹1,500,000.00 - ₹2,500,000.00 per year

Benefits:

- Paid time off
- Work from home

Work Location: Remote

📌 Lead Data Engineer – SAP Ariba Integration | Azure Databricks (India)
🏢 K9V Tech & AI
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer – sap ariba integration | azure databricks (india) / india