Role Overview
We are looking for a Senior Data Engineer (15+ years) with deep hands-on experience in database development, Oracle PL/SQL, and large-scale Azure cloud migration to independently own and deliver complex migration and integration workstreams with minimal supervision. The role covers reverse-engineering legacy database logic, designing and implementing Azure-based data pipelines, and ensuring functional equivalence, data integrity, and traceability throughout the migration lifecycle.
Scope of Work
- Independently analyze, interpret, and reverse-engineer existing PL/SQL code, database objects, and data processing logic from legacy systems.
- Adapt, refactor, or rewrite extracted logic to support Azure-based data migration and integration workflows, ensuring functional equivalence, data integrity, and traceability.
- Design and implement data movement, transformation, and orchestration pipelines using Azure Data Factory and related Azure services.
- Perform detailed source-to-target mapping, data transformation analysis, reconciliation, and validation as part of large-scale data migration initiatives.
- Collaborate with data modelers and architects to align conceptual, logical, and physical data models with migration and integration requirements.
- Produce and maintain migration design documents, Low-Level Design (LLD), mapping specifications, unit test plans, and validation reports.
- Provide technical guidance to testing, integration, and downstream teams on migration logic, data validation strategies, and testing expectations.
- Support integration testing and UAT by validating data consistency and correctness across upstream and downstream systems.
- Perform in-depth troubleshooting,
root cause analysis, and resolution of migration-related data issues across environments.
- Ensure adherence to data governance standards, security controls, performance guidelines, and cloud best practices.
- Proactively manage work items, timelines, dependencies, and risks; communicate issues and trade-offs to technical and business stakeholders.
- Participate in SCRUM ceremonies; work closely with onsite and offshore teams while maintaining ownership of assigned deliverables.
- Assist with documentation and artifacts for security clearance, release readiness, and production deployment.
Skills & Experience Required
- 15+ years of overall professional experience with solid focus on enterprise data migration, system modernization, and integration initiatives.
- 8–10 years of experience in Data Modelling, Data/Information Architecture, Metadata Management, Master Data Management, Data Governance, and Data Quality.
- Deep understanding of Oracle PL/SQL logic and database behavior; demonstrated ability to analyze and reverse-engineer complex legacy implementations.
- Expertise in Azure platforms — Azure Databricks, ADLS, Delta Lake, and their various components.
- In-depth hands-on experience with the Microsoft Azure data stack: Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions,
Logic Apps, Event Hubs, Function Apps, APIM, and Web Apps.
- Strong experience designing ETL/ELT pipelines and data flows using Azure Data Factory (primary); SSIS and Informatica as additional skills.
- In-depth knowledge of designing ETL pipelines for batch and real-time processing in Azure Data Factory.
- Thorough understanding of data lakes, Delta Lakes, and raw/enriched/curated layer concepts and ETL within the Azure framework; experience executing end-to-end projects focusing on Azure Synapse and Delta Lake.
- Proficiency in Python, SQL, Spark notebooks, and Scala; strong development and design skills in MS SQL Server and Oracle.
- Experience with Big Data architecture concepts, data sourcing, ingestion, curation, and storage mechanisms; real-time and near-real-time data warehousing concepts.
- Experience leveraging Azure Automation, Azure PowerShell scripting, AzCopy, Azure DevOps, and ARM Templates.
- Experience handling large-volume data migrations, reconciliation, validation, and cross-system data consistency checks.
- Strong understanding of data modelling concepts — relational structures, surrogate and composite keys, cross-reference tables, and migration-friendly data designs.
- Experience with Salesforce migration is a plus.
- Demonstrated ability to work as a senior individual contributor, independently owning complex migration workstreams.
- Strong analytical and root cause analysis skills; excellent written and verbal communication with technical and non-technical stakeholders.
- Highly organized with strong ownership of deliverables, documentation, and timelines.
📌 Senior Data Engineer (India)
🏢 Papigen
📍 India