Core Required Skills
- Programming Languages: Advanced proficiency in Python and SQL.
- Data Processing: Mastery of PySpark / Spark SQL for production-grade data manipulation.
- Databricks Stack: Deep experience with Delta Lake, Unity Catalog, and Databricks Workflows/Jobs.
- Cloud Platforms: Robust hands-on experience integrating Databricks within cloud ecosystems like AWS (S3, Glue) or Azure (Azure Data Factory, Azure Synapse).
- DevOps: Working knowledge of Git, CI/CD pipelines, and basic containerization tools.
Preferred Qualifications
- Certifications: Databricks Certified Data Engineer (Associate or Professional) or Databricks Certified Developer.