We are seeking a seasoned Databricks Professional with 8 years of experience to lead our data platforms performance tuning and nextgeneration AI initiatives
EndtoEnd Medallion Architecture Build deploy and maintain robust data pipelines following industry best practices across Bronze raw ingest Silver cleanedconformed and Gold businessready aggregates layers
Pipeline Optimization Audit refactor and finetune existing data pipelines to eliminate bottlenecks reduce compute costs and maximize throughput using Photon Liquid Clustering and Delta Live Tables DLT
GenAI Data Prep Implementation Architect and curate Databricks AI Genies by structuring clean wellgoverned Gold layers and semantic spaces to enable accurate natural language querying
Required Skills Qualifications
8 years of experience in data engineering big data platform delivery.
Robust handson expertise with Databricks and Apache Spark PySparkScala.
Deep experience implementing Medallion Architecture BronzeSilverGold with Delta Lake.
Proven experience in performance tuning and cost optimization on Databricks.
Strong knowledge of Photon Liquid Clustering and Delta Live Tables DLT design operationalization.