19 Aug
|
HTC Global Services
|
Bengaluru
19 Aug
HTC Global Services
Bengaluru
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using Dataproc on GCP.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop complex queries in BigQuery to extract insights from massive datasets stored in Cloud Storage.
- Troubleshoot issues related to PubSub messaging queues and resolve them efficiently.
Job Requirements :
7+ years of total experience in data engineering, data platforms, or data-centric software engineering. 5+ years of hands-on experience designing and building data pipelines, ETL/ELT workflows, and cloud-native data solutions. 3+ years of direct experience with Google Cloud Platform (GCP) using services such as BigQuery, Cloud Storage, Cloud Run, Datafusion, Dataproc, Composer, and Pub/Sub. Advanced proficiency in SQL, Python,
and PySpark for data processing and transformation. Proven experience developing and supporting production-grade, end-to-end cloud data pipelines. Expertise in ELT/ETL design, performance optimization, and data transformation frameworks. Solid background in monitoring, logging, alerting, and data quality frameworks across distributed systems. Experience with DevOps tools and techniques, including CI/CD, GitHub, and related automation practices. Demonstrated experience working in global, cross-functional, and agile development environments. Excellent communication, problem-solving, and analytical skills with the ability to collaborate across technical and non-technical teams. GCP certification preferred (e.g., Google Cloud Professional Data Engineer).
📌 GCP Data Engineer (Bengaluru)
🏢 HTC Global Services
📍 Bengaluru