- We're looking for an experienced Technical Architect – Databricks & ADF to lead the design and implementation of scalable, high-performance data platforms.
- Must have Data Engineering architecting experience (Databricks &;ADF)
- Design, build, and optimize scalable data pipelines using Databricks, Spark, and Azure Data Factory (ADF).
- Implement productive data ingestion strategies (incremental loads, CDC) and manage schema evolution in ADLS.
- Apply Spark optimization techniques including partitioning, caching, and performance tuning.
- Configure and manage Spark clusters, executor settings, and resource allocation for large-scale worklads.
- Collaborate with cross-functional teams to define data architecture and ensure high data quality and reliability.
- 10+ years experience in Azure data ecosystem with strong hands-on expertise in Databricks, ADF, and PySpark.