Seeking a Databricks Engineer to design and develop up-to-date data engineering, analytics, and AI solutions using the Databricks platform.
Responsibilities:
- Develop data pipelines using Databricks.
- Build Lakehouse architectures.
- Develop notebooks using Python/PySpark/SQL.
- Implement Delta Lake solutions.
- Build ETL/ELT pipelines.
- Optimize Spark workloads.
- Implement data quality and governance.
- Integrate Databricks with cloud storage and enterprise systems.
- Support machine learning and AI workloads.
- Implement CI/CD for Databricks deployments.