Job Description (JD) GCP Data Engineer (BigQuery, Dataproc, Dataflow)
- Design, develop, and maintain scalable data pipelines using Google Cloud Platform (GCP) services including BigQuery, Dataproc, and Dataflow.
- Build ETL/ELT workflows for processing large-scale structured and unstructured data from multiple sources.
- Optimize BigQuery data models, queries, and performance for analytics and reporting requirements.
- Implement batch and real-time data processing solutions using Dataproc (Spark/Hadoop) and Dataflow (Apache Beam).
- Collaborate with cross-functional teams to ensure data quality, security, governance, and cloud best practices.