Job Summary

We are looking for an experienced MDM Developer with strong expertise in PySpark and Java to design, develop, and maintain scalable data processing pipelines and master data management solutions. The candidate will be responsible for data integration, transformation, cleansing, deduplication, and synchronization across enterprise systems.

Key Responsibilities

- Design and develop scalable data processing pipelines using Apache Spark and PySpark.
- Develop backend applications and REST APIs using Java and Spring Boot.
- Build ETL/ELT pipelines for processing large volumes of structured and semi-structured data.
- Implement MDM processes, including data matching, merging, deduplication, and survivorship rules.
- Integrate master data from ERP, CRM, databases, APIs, and external systems.
- Develop data validation, standardization, and quality-checking frameworks.
- Optimize PySpark jobs for performance, memory utilization, and distributed processing.
- Design and maintain batch and near-real-time data synchronization workflows.
- Troubleshoot production issues and ensure data consistency across applications.
- Collaborate with data engineering, architecture, and business teams.

Required Technical Skills

Technology

Expected Expertise

PySpark





Strong hands-on experience with Spark DataFrames, transformations, joins, aggregations, and performance optimization

Java

Core Java, Java 8+, Spring Boot, REST APIs

SQL

Complex queries, joins, stored procedures, query optimization

Apache Spark

Distributed processing, partitioning, caching, Spark SQL

MDM

Data matching, deduplication, survivorship, golden records

ETL/ELT

Data extraction, transformation, loading, and orchestration

Databases

PostgreSQL, MySQL, Oracle, or SQL Server

Data Formats

JSON, CSV, Parquet, XML

Version Control

Git, CI/CD pipelines

Good to Have

- Experience with AWS Glue, EMR, S3, or Azure Databricks.
- Knowledge of Apache Kafka for event-driven data integration.
- Experience with Delta Lake or data lakehouse architectures.
- Exposure to Informatica MDM, Reltio, or similar MDM platforms.
- Experience with Docker, Kubernetes, and cloud deployments.
- Knowledge of data governance, metadata management, and data lineage.

Pay: ₹1,075,000.00 - ₹2,010,000.00 per year

Advantages

- Paid time off
- Provident Fund

Work Location: Hybrid remote in Chennai, Tamil Nadu

📌 MDM Developer / Senior Software Engineer (Chennai)
🏢 Predfut Technology
📍 Chennai