- Design, develop, test, deploy and maintain large-scale data pipelines using BigQuery, Data Flow, PubSub and other GCP services.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop machine learning models using Python on Dataproc clusters for big data processing.
- Troubleshoot complex issues related to pipeline failures or errors in the system.
Job Requirements :
- 4-10 years of experience in software engineering with expertise in artificial intelligence, machine learning, MCP (Multi-Cloud Platform) architecture.
- Solid understanding of Google Cloud Platform (GCP) services such as BigQuery, Data Flow, PubSub etc. .
- Proficiency in composing code snippets using Python programming language.
- Experience working with cloud storage solutions like Cloud Storage.