- Strong experience with GCP services (BigQuery, Pub/Sub, Cloud Storage, Dataflow) and proficiency in Python, Java, or C++
- Design and develop scalable data architectures and pipelines on GCP; ensure data quality and optimize workflows; troubleshoot technical issues
The ideal candidate will have a robust background in designing, developing, and implementing large-scale data pipelines on Google Cloud Platform.
Roles and Responsibility
- Design and develop scalable and efficient data architectures on GCP.
- Collaborate with cross-functional teams to identify and prioritize project requirements.
- Develop and maintain large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
- Ensure data quality and integrity by implementing robust testing and validation frameworks.
- Optimize data processing workflows for performance, scalability, and cost-effectiveness.
- Troubleshoot complex technical issues related to data engineering projects.
Job Requirements
- Strong experience with GCP services including BigQuery, Pub/Sub, Cloud Storage, and Dataflow.
- Proficiency in programming languages such as Python, Java, or C++.
- Experience with data modeling, data warehousing, and ETL processes.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a fast-paced environment.
- Strong understanding of cloud computing concepts and data security best practices.