Dataiku Platform Engineer

Location: Remote
Experience: 5+ Years

Position Overview

We are looking for an experienced Dataiku Platform Engineer to design, develop, and support a Dataiku-based processing platform for data transformation, business rules, reconciliation, and decisioning.

The role involves modernizing legacy Access databases, Excel workbooks, and VBA-based processes into scalable, governed, and auditable Dataiku pipelines.

Key Responsibilities

- Design and maintain Dataiku DSS workflows, scenarios, recipes, and automation.
- Build scalable data ingestion, transformation, reconciliation, and business-rule processing pipelines.
- Develop reusable frameworks for source onboarding, data validation, exception handling, and metadata-driven processing.
- Reverse engineer and migrate MS Access queries, Excel formulas, VBA modules, and macros into Dataiku.
- Implement pricing, variance, reconciliation, breach detection, and exposure analysis.
- Build Data Quality Firewall controls, validation checks, quarantine workflows, and exception handling.
- Ensure data lineage, traceability, auditability, and reproducibility.
- Support SOX, security, governance, and audit-readiness requirements.
- Integrate Dataiku with PostgreSQL/Amazon RDS, Power BI, Power Automate, Murex, SOLARC, Position Manager, and Azure services.
- Collaborate with DevOps teams on Git-based CI/CD and automated deployments.
- Support UAT, SIT, reconciliation testing, parallel runs, production releases, and root-cause analysis.

Required Skills





- 5+ years of experience in Data Engineering or Data Platform Development.
- 3+ years of hands-on Dataiku DSS experience.
- Robust Python development skills.
- Advanced SQL programming.
- Experience with ETL/ELT pipelines and transformation frameworks.
- Experience with PostgreSQL and relational databases.
- Knowledge of Data Quality, Reconciliation, Metadata Management, and Data Lineage.
- Experience with Git, CI/CD, and DevOps practices.
- Experience working in regulated, compliance-driven, or audit-sensitive environments.
- Strong analytical and problem-solving skills.

Preferred Skills

- Commodity Trading, Energy, Risk, or Financial Services experience.
- Experience with valuation, market data, or pricing platforms.
- Power Automate integration experience.
- Azure AI Document Intelligence familiarity.
- Murex integration experience.
- Amazon RDS exposure.
- Experience implementing SOX-compliant solutions.
- Experience with enterprise-scale Dataiku environments.
- Dataiku certifications such as Core Designer, Advanced Designer, or Developer.
- Microsoft Azure Data Engineer or AWS Data Analytics certification.

Key Deliverables

- Dataiku Processing Factory
- Metadata-Driven Ingestion Framework
- Business Rules Catalog
- Data Quality and Reconciliation Framework
- Consensus and Variance Processing Engine
- Audit Evidence and Replay Framework
- Integration Components
- Production Deployment Packages
- Technical Documentation and Knowledge Transfer

Pay: ₹70,000.00 - ₹110,000.00 per month

Experience:

- Data Platform Development: 5 years (Required)

Work Location: Remote

📌 Dataiku Platform Engineer (India)
🏢 Tech Next
📍 India