Roles and Responsibilities
Design, develop, test, and deploy data pipelines using DataBricks to extract insights from large datasets.
Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
Develop high-quality code in Python using PySpark for big data processing tasks such as ETL, data transformation, and analytics.