31 Jul
|
Allianz Services
|
India
31 Jul
Allianz Services
India
Job Description – Senior Data Engineer / Platform Re-Engineering Lead (Azure Synapse & Databricks Migration)
Role Overview We are looking for a highly experienced Senior Data Engineer to lead the re-engineering of an existing enterprise data platform built on Azure Synapse Analytics. The role requires deep technical seniority to audit, understand, and validate a complex end-to-end data architecture spanning source ingestion through to consumption — and to drive a future migration of validated workloads to Databricks. This is not a greenfield role: it demands the ability to reverse-engineer existing implementations, assess their correctness, and own the technical migration strategy.
Key Responsibilities
Lead the technical assessment and re-engineering of an existing enterprise data platform, spanning all layers from source ingestion through to data consumption
Reverse-engineer, document, and validate existing pipeline logic, data models, transformation frameworks, and data governance controls
Identify gaps, defects,
and technical debt across the platform and remediate where implementations are incorrect or sub-optimal
Ensure correctness of data processing patterns including change data capture, slowly changing dimensions, deduplication, and business reconciliation
Design and implement target-state architectures aligned to contemporary lakehouse principles, ensuring feature parity and business logic fidelity during transitions
Manage platform evolution initiatives, including parallel-run phases where multiple implementations operate simultaneously, validating output consistency before cutover
Define and execute migration strategies for existing workloads to up-to-date data platforms, preserving existing governance and control framework semantics
Re-implement ingestion, transformation, and orchestration pipelines on target platforms, maintaining audit, quality, and reconciliation standards
Collaborate with business, data governance, and architecture stakeholders to validate e
📌 Senior Consultant Data Engineer Pune (India)
🏢 Allianz Services
📍 India