As a Solution Architect – Databricks, you will design and deliver enterprise‑grade data solutions on Azure Databricks, leading a large‑scale data modernisation programme for a telecommunications client. You will architect migration strategies, define governance frameworks, and provide technical leadership to ensure seamless transformation from legacy data warehousing systems to a contemporary lakehouse architecture.
What You’ll Do and How You’ll Succeed
Architecture & Design
Design and architect end‑to‑end data pipelines using Azure Databricks with Medallion Architecture (Bronze Silver Gold Semantic layers).
Lead hybrid orchestration frameworks combining DLT‑Lakeflow for CDC ingestion and metadata‑driven frameworks for transformation layers.
Define and implement Unity Catalog governance strategies for data access, security, and lineage.
Architect Databricks Workflows for job scheduling, dependency management, and replacing legacy Control‑M orchestration.
Design SCD Type 2 implementations and complex transformation patterns for EDW migration.
Technical Leadership
Provide guidance on PySpark and Spark SQL best practices for large‑scale data processing.
Define coding standards, modular notebook organisation, and configuration‑driven development approaches.
Lead technical decisions on schema evolution, data quality frameworks, and reconciliation strategies.
Recommend approaches for surrogate key generation, batch control mechanisms, and selective reprocessing.
Migration & Modernisation
Architect migration strategies from legacy systems (ODS, EDW, Informatica PowerCenter) to Azure Databricks lakehouse.
Design CDC ingestion patterns using Oracle GoldenGate and Informatica IDR integration.
Define approaches for historical data migration and parallel run strategies.
Ensure minimal refactoring of existing SQL/PySpark code through metadata‑driven frameworks.
Operational Excellence
Design solutions supporting BAU operations including manual data patching, hold/resume/skip contr
📌 Solution Architect (India)
🏢 Thakral One
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.