K9V Tech is hiring a Lead Data Engineer – SAP Ariba Integration Stream Lead for an enterprise Azure Databricks Lakehouse programme.
The role will focus on replacing existing file- and bot-based ingestion with a production-grade API-driven data pipeline and bringing supplier, sourcing and negotiation data from SAP Ariba into the enterprise Lakehouse.
The ideal candidate should have strong hands-on experience with SAP Ariba APIs, Python, PySpark, Databricks, REST APIs, Delta Lake and production data pipelines.
Key Responsibilities
- Lead the SAP Ariba integration stream.
- Build and own API-based ingestion pipelines from SAP Ariba.
- Replace legacy file/bot-based extraction with scalable API-driven ingestion.
- Run parallel operations against existing feeds and reconcile results.
- Lead cutover activities without downstream disruption.
- Work with business users to confirm data objects, grain and required attributes.
- Build Bronze and Silver layers for SAP Ariba data.
- Conform supplier/vendor information with the ERP master data.
- Develop historical data backfill pipelines.
- Implement daily incremental ingestion.
- Build Gold data products for BI consumption.
- Create data dictionaries and schema contracts for downstream AI/ML teams.
- Establish data-quality rules and monitoring.
- Implement schema-drift detection.
- Own reconciliation processes and data-quality outcomes.
Mandatory Skills
- 7–12 years of Data Engineering experience.
- Strong hands-on experience with Azure Databricks.
- Hands-on production experience with SAP Ariba APIs.
- Experience with:
- SAP Ariba Operational Reporting API
- SAP API Business Hub
- Functional knowledge of SAP Ariba.
- Experience with Sourcing and/or Supplier Lifecycle & Performance (SLP) data objects.
- Advanced Python programming.
- Robust PySpark experience.
- Experience developing production pipelines in Databricks.
- Strong REST API integration experience.
- Experience with:
- OAuth2
- API-key authentication
- Pagination
- API throttling
- Retry mechanisms
- Incremental watermarking
- Experience modelling semi-structured JSON responses into tabular/conformed schemas.
- Experience designing idempotent and replayable pipelines.
- Experience with schema-drift detection.
- Strong experience with Databricks Workflows.
- Strong experience with Delta Lake.
- Experience with Azure Key Vault or equivalent secrets-management solutions.
- Experience with cross-system master-data conformance.
- Strong data-quality, monitoring and reconciliation experience.
Good to Have
- Historical bulk-load approaches for SaaS sources.
- Data Transfer Tool / SFTP extraction experience.
- SAP Ariba CIG concepts.
- UiPath or other RPA exposure.
- SaaS-to-Lakehouse integration experience.
- SaaS-to-warehouse integration experience.
- Experience creating data dictionaries and schema contracts for AI/ML consumers.
- SAP ECC vendor-master familiarity.
Ideal Candidate
The ideal candidate is a hands-on Lead Data Engineer who can independently design, develop and lead production-grade SAP Ariba integrations on Azure Databricks.
You should be comfortable working across APIs, data engineering, data modelling, orchestration, data quality and enterprise master-data integration.
Application
Interested candidates can share their updated CV at:
[email protected] &
[email protected]
Please mention "Lead Data Engineer – SAP Ariba Integration" in the email subject line.
Pay: ₹1,500,000.00 - ₹2,500,000.00 per year
Benefits:
- Paid time off
- Work from home
Work Location: Remote
📌 Lead Data Engineer – SAP Ariba Integration | Azure Databricks (India)
🏢 K9V Tech & AI
📍 India