Roles and Responsibilities
Design, develop, and maintain large-scale data pipelines using BigQuery, Dataproc, and other GCP services.
Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
Develop automation scripts using Python to streamline data processing tasks and improve efficiency.
Troubleshoot issues related to data quality, performance, and security in the pipeline.