19 Oct
|
Technoworkz Technologies
|
Bengaluru
19 Oct
Technoworkz Technologies
Bengaluru
: GCP Data Engineer
Role Overview
We are seeking experienced GCP Data Engineers to design, build, and optimize scalable data pipelines and analytics solutions on Google Cloud Platform (GCP). The role requires solid expertise in Python, SQL, PySpark, Dataproc, and Dataflow to deliver enterprise-grade data engineering capabilities.
Key Responsibilities
Data Pipeline Development: Build and maintain ETL/ELT pipelines using Dataflow, Dataproc, and PySpark.
Data Modeling: Design effective schemas and implement partitioning/clustering strategies in BigQuery.
Workflow Orchestration: Automate and monitor workflows using Cloud Composer (Airflow).
Data Integration: Connect diverse sources (databases, APIs, cloud storage) into unified pipelines.
Performance Optimization: Tune queries, optimize jobs, and ensure cost-efficient execution.
Collaboration: Partner with architects, analysts, and business stakeholders to deliver actionable insights.
Production Support: Troubleshoot issues, ensure pipeline reliability,
and follow CI/CD best practices.
Mandatory Skills
Hands-on expertise in Google Cloud Platform (GCP) services: Dataflow, Dataproc, BigQuery, Pub/Sub, Cloud Storage.
Strong programming skills in Python, SQL, PySpark.
Experience with ETL/ELT pipelines, data modeling, and warehousing concepts.
Familiarity with CI/CD pipelines, Git, and Agile methodology.
Preferred Skills
Experience with Cloud Composer (Airflow) for orchestration.
Exposure to Apache Beam, Hadoop ecosystem, and shell scripting.
Multi-cloud experience (AWS/Azure/GCP).
Understanding of data governance frameworks.
Candidate Profile
Experience: 5–10 years in Data Engineering (minimum 2+ years on GCP).
Education: Bachelor’s/Master’s in Computer Science, IT, or related field.
Location: Open to major tech hubs (e.g., Bengaluru, Chennai).
Employment Type: Full time, permanent.
📌 Gcp Data Engineer Bengaluru
🏢 Technoworkz Technologies
📍 Bengaluru