05 Nov
|
Q1 Technologies India PVT
|
Noida
05 Nov
Q1 Technologies India PVT
Noida
Senior Data Engineer with solid Databricks, SQL and data warehousing experience to lead the migration of an existing Oracle-based data warehouse to Databricks on the Allianz Data Platform (ADP). Experience with modern data engineering practices and AI-enabling data platforms is highly desirable. Duties and responsibilities
Analyse the current Oracle data warehouse (including PostgreSQL source feeds and SAS ETL generated structures) and design the target model in Databricks.
Build and optimise ETL/ELT pipelines in Databricks (Spark SQL, PySpark) to migrate core data warehouse tables and datamarts from Oracle to Databricks.
Translate Oracle SQL/PL-SQL logic into Databricks Spark SQL and PySpark, ensuring functional equivalence and performance optimisation.
Ensure data quality, performance,
and reliability of the new Databricks-based data warehouse, enabling downstream analytics and AI/ML use cases.
Collaborate closely with the Enterprise Architect, ADP platform team and business stakeholders to align with architecture, standards, and best practices.
Document migration patterns, data models, and operational procedures to support long-term maintainability and reusability. Qualification, Experience, Technical and Functional Skills Must Have:
Experience of 6-9 years of experience in ITIL process/application support/Deployment activities.t. Positive attitude, proactively provides solutions
📌 Azure Data Engineer_Hexaware (Noida)
🏢 Q1 Technologies India PVT
📍 Noida