Overall Objectives of job We are looking for a Senior Data Engineer with strong Databricks, SQL and data warehousing experience to lead the migration of an existing Oracle-based data warehouse to Databricks on the Allianz Data Platform (ADP). Experience with modern data engineering practices and AI-enabling data platforms is highly desirable. Duties and responsibilities
• Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETLgenerated structures) and design the target model in Databricks.
• Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks.
• Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation.
• Ensure data quality, performance, and reliability of the recent Databricks-based data warehouse,
enabling downstream analytics and AI/ML use cases.
• Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices.
• Document migration patterns, data models, and operational procedures to support long-term maintainability and reusability. Qualification, Experience, Technical and Functional Skills Must Have:
• Graduate or Postgraduate in Engineering or a Postgraduate in non-engineering disciplines .
• Experience of 5-9 years of experience in ITIL process/application support/Deployment activities.t.
• Positive attitude, proactively provides solutionsRole & responsibilities Preferred candidate profile Perks and benefits
📌 Walk-in || Data Engineer (Pune)
🏢 Coders Brain
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.