About the Role
We are seeking a Senior Data Platform Engineer with extensive hands-on experience to build and scale enterprise-grade data pipelines on Azure and Databricks. This role requires deep technical expertise, solid ownership, and the ability to independently deliver complex, production-ready data solutions while setting engineering best practices.
What You'll Do
- Build scalable pipelines using Databricks (DLT, Autoloader, Workflows) and Azure services
- Extend metadata-driven ingestion frameworks (declarative, reusable)
- Develop modular PySpark code and libraries (WHL packaging)
- Implement Delta Lake patterns (CDC, SCD Type 2, merges)
- Optimize SQL workloads for performance and cost
- Orchestrate pipelines via Synapse or UC4
- Apply data modeling (Kimball, 3NF, lakehouse)
- Implement CI/CD with Azure DevOps
- Enforce governance via Unity Catalog
- Mentor engineers and contribute to engineering standards