We are seeking a seasoned Databricks Professional with 8+ years of experience to lead our data platforms performance tuning and nextgeneration AI initiatives
Endto End Medallion Architecture Build deploy and maintain robust data pipelines following industry best practices across Bronze raw ingest Silver cleanedconformed and Gold businessready aggregates layers
Pipeline Optimization Audit refactor and finetune existing data pipelines to eliminate bottlenecks reduce compute costs and maximize throughput using Photon Liquid Clustering and Delta Live Tables DLT
GenAI Data Prep Implementation Architect and curate Databricks AI Genies by structuring clean wellgoverned Gold layers and semantic spaces to enable accurate natural language querying
Required Skills Qualifications
8+ years of experience in data engineering big data platform delivery.
Strong handson expertise with Databricks and Apache Spark PySpark Scala.
Deep experience implementing Medallion Architecture Bronze Silver Gold with Delta Lake.
Proven experience in performance tuning and cost optimization on Databricks.
Strong knowledge of Photon Liquid Clustering and Delta Live Tables DLT design operationalization.