- Develop and optimize data pipelines using Databricks and PySpark.
- Build scalable ETL/ELT solutions for large datasets.
- Design and maintain Delta Lake architectures.
- Integrate Databricks with Azure Data Factory, ADLS, and other cloud services.
- Write effective Spark and SQL queries for data transformations.
- Monitor and improve performance of data workloads.
- Implement data quality, governance, and security standards.
- Collaborate with analytics and business teams to deliver data solutions.