Data Engineer – OSDU & Microsoft Fabric | Kuala Lumpur, Malaysia

Location: Kuala Lumpur, Malaysia

Work Mode: Onsite

Experience: 5–10 Years

Employment Type: Full-Time

About the Role

NexusCurve is looking for an experienced Data Engineer with hands-on experience in both OSDU (Open Subsurface Data Universe) and Microsoft Fabric to join a data engineering team supporting contemporary cloud-based data platforms.

The ideal candidate will have robust experience in data engineering, data ingestion, data transformation, Python and SQL , along with practical experience working with the OSDU Data Platform and Microsoft Fabric .

This is an onsite opportunity in Kuala Lumpur, Malaysia .

Key Responsibilities

- Design, develop and maintain scalable data engineering and data ingestion pipelines using Microsoft Fabric .
- Work with the OSDU Data Platform for data ingestion, transformation, storage, search and retrieval.
- Develop and maintain data pipelines integrating data from multiple enterprise and upstream sources into OSDU.
- Build data solutions using Microsoft Fabric Data Factory, Data Pipelines, Lakehouse and Data Engineering capabilities .
- Develop data transformation and processing solutions using Python, SQL and PySpark .
- Work with OSDU schemas, data models, JSON manifests and OSDU APIs.
- Perform source-to-target data mapping, transformation, validation and data quality checks.
- Develop and consume REST APIs for data integration and OSDU data ingestion.
- Troubleshoot data pipeline failures, ingestion issues and data quality problems.
- Implement appropriate monitoring, logging, testing and operational processes for data pipelines.
- Collaborate with data architects, engineers, business stakeholders and domain teams.
- Support data migration and data modernization initiatives.
- Follow Git, CI/CD and DevOps practices for data engineering solutions.
- Contribute to continuous improvement of OSDU and Microsoft Fabric data platform capabilities.

Mandatory Skills & Experience




- 5–10 years of overall Data Engineering / IT experience.
- Hands-on experience with OSDU (Open Subsurface Data Universe).
- Hands-on experience with Microsoft Fabric.
- Strong experience developing data pipelines and data ingestion solutions .
- Strong programming/scripting experience in Python .
- Strong SQL skills.
- Experience with ETL/ELT, data transformation and data integration .
- Experience with Microsoft Fabric Data Factory, Data Pipelines, Lakehouse and/or Data Engineering capabilities.
- Practical experience with OSDU data ingestion, OSDU APIs and/or OSDU platform services .
- Experience working with REST APIs and JSON .
- Experience with cloud-based data platforms, preferably Microsoft Azure .
- Experience with Git and CI/CD practices.
- Strong understanding of data modelling, data quality and data engineering best practices.
- Strong analytical and troubleshooting skills.

OSDU Experience Candidates should have practical project experience with one or more of the following:
- OSDU Data Platform
- OSDU Data Lake
- OSDU data ingestion
- OSDU Schema Service
- OSDU Storage Service
- OSDU Search Service
- OSDU APIs
- JSON manifests
- OSDU data transformation and mapping
- OSDU data migration
- Integration with upstream or subsurface data sources

Microsoft Fabric Experience Hands-on experience with relevant Microsoft Fabric capabilities, such as:
- Microsoft Fabric Data Factory
- Fabric Data Pipelines
- Fabric Lakehouse
- Fabric Data Engineering
- Fabric Notebooks
- PySpark / Spark
- SQL
- Data ingestion and transformation
- Data integration





Experience with Azure Data Factory, Azure Data Lake, Azure Databricks, Synapse or other Azure data services is an advantage. Domain Experience – Preferred

Experience in the Oil & Gas, Energy, Upstream or Subsurface domain is preferred but not mandatory .

Exposure to any of the following will be an advantage:

- Subsurface data
- Well / Wellbore data
- Seismic data
- Geoscience data
- Production data
- Petroleum data management
- PPDM or related data standards
- Energy data platforms

Good to Have
- Experience with Azure Data Manager for Energy (ADME) .
- Experience with Python-based OSDU automation.
- Experience with Apache Airflow or similar workflow orchestration tools.
- Experience with Docker, Kubernetes or OpenShift.
- Experience with Power BI / Microsoft Fabric analytics.
- Knowledge of Microsoft Purview and data governance.
- Experience with migration from legacy data platforms to OSDU.
- Experience working with large-scale cloud data platforms.
- Exposure to OSDU community or open-source projects.

Candidate Profile We are particularly interested in candidates who can demonstrate real project experience with BOTH OSDU and Microsoft Fabric .

OSDU and Microsoft Fabric should be demonstrated through actual project experience rather than appearing only as keywords on the resume.

Candidates must be willing and able to work onsite in Kuala Lumpur, Malaysia .

How to Apply

Interested candidates can share their updated CV with:

[email protected]

Please mention "Data Engineer – OSDU & Microsoft Fabric – Kuala Lumpur" in the subject line.

Please include the following information:

- Total Experience
- Relevant OSDU Experience
- Relevant Microsoft Fabric Experience
- Current Location
- Notice Period / Earliest Joining Date
- Willingness to work onsite in Kuala Lumpur, Malaysia

NexusCurve https://www.linkedin.com/company/nexuscurve Pallav

- https://www.linkedin.com/in/pallav88/

📌 Sr. Data Engineer – OSDU & Microsoft Fabric | Kuala Lumpur, Malaysia (India)
🏢 NexusCurve
📍 India