28 Sep
|
Multi National
|
Tamil Nadu
28 Sep
Multi National
Tamil Nadu
Job Title: Senior Data Engineer – Customer Data Platform (CDP)
nAbout the Role
nWe are looking for an experienced Senior Data Engineer – Customer Data Platform (CDP) to design, build, and operate an enterprise-scale Customer Data Platform that unifies customer data from multiple source systems into a centralized Customer 360 platform. You will develop scalable data pipelines, implement identity resolution, build real-time data processing solutions, and enable customer insights for CRM, Marketing, Analytics, AI/ML, Contact Center, Campaign Management, and other enterprise applications.
nn
nKey Responsibilities
n· Design and build scalable Customer Data Platform solutions.
n· Develop ETL/ELT, CDC, and real-time streaming pipelines.
n· Build and maintain Customer 360 profiles, golden records, and identity resolution capabilities.
n· Develop data models, customer segmentation, and profile enrichment pipelines.
n· Integrate customer data with downstream applications through APIs, event streaming, and Reverse ETL.
n· Ensure data quality, governance, security, and compliance.
n· Optimize data pipelines, monitor platform performance, and troubleshoot production issues.
n· Collaborate with Product, Marketing, AI/ML, Analytics, and Engineering teams to deliver scalable customer data solutions.
n· Mentor junior engineers and contribute to architecture and engineering best practices.
nn
nRequired Skills & Experience
n· 6+ years of experience in Data Engineering with at least 3 years in Customer Data Platforms (CDP), Master Data Management (MDM), or Customer 360 solutions.
n· Robust expertise in SQL, Python and/or Scala, Apache Spark/PySpark.
n· Hands-on experience with cloud data platforms such as Databricks, Snowflake, BigQuery, or Redshift.
n· Experience with real-time streaming technologies (Kafka, Kinesis, or Pub/Sub).
n· Strong knowledge of ETL/ELT, CDC, data modeling, SCD, and data warehousing.
n· Experience implementing customer identity resolution and Customer 360 solutions.
n· Hands-on experience with Neo4j or other graph databases.
n· Experience with AWS, Azure, or GCP.
n· Familiarity with Reverse ETL, REST APIs, and event-driven architectures.
nn
nPreferred Skills
n· Experience with Delta Lake, Apache Iceberg, or Apache Hudi.
n· Knowledge of data governance, privacy, and consent management.
n· Experience supporting AI/ML and analytics data platforms.
n· Exposure to enterprise-scale customer data platforms handling high-volume data processing.
nn
nTechnology Stack
nLanguages: SQL, Python, Scala
nData Processing: Apache Spark, PySpark
nGraph Database: Neo4j
nData Platforms: Databricks, Snowflake, BigQuery, Redshift
nStreaming: Kafka, Kinesis, Pub/Sub
nCDC: Debezium, Fivetran
nCloud: AWS, Azure, GCP
nData Lake: S3, ADLS, GCS, Delta Lake, Iceberg, Hudi
nIntegration: REST APIs, Reverse ETL, Webhooks
📌 Senior Data Engineer (Tamil Nadu)
🏢 Multi National
📍 Tamil Nadu