28 Sep
|
HCLTech
|
Chennai
Position: GCP Data Engineer
nExperience: 5+ Years
nLocation: Hybrid/Remote/Onsite
nEmployment Type: Full time
nJob Summary
nWe are seeking an experienced GCP Data Engineer with strong expertise in Google Cloud Platform (GCP), BigQuery, SQL, and PySpark . The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing data processing workflows, and supporting enterprise analytics and reporting initiatives.
nKey Responsibilities
n
n
Design, build, and maintain scalable ETL/ELT data pipelines on GCP.
n
Develop and optimize data solutions using BigQuery for large-scale data warehousing and analytics.
n
Create effective data transformation workflows using PySpark .
n
Write complex SQL queries, stored procedures, and performance-tuning scripts.
n
Ingest data from multiple structured and unstructured sources into GCP environments.
n
Implement data quality, validation, and monitoring frameworks.
n
Collaborate with business stakeholders, analysts, and data scientists to understand data requirements.
n
Optimize query performance, partitioning, clustering, and cost management in BigQuery.
n
Troubleshoot and resolve data pipeline and performance issues.
n
Follow best practices for security, governance, and compliance within GCP.
n
nRequired Skills
n
n
5+ years of experience in Data Engineering.
n
Strong experience with Google Cloud Platform (GCP) .
n
Expertise in BigQuery and advanced SQL .
n
Hands-on experience with PySpark for data transformation and processing.
n
Experience building ETL/ELT pipelines.
n
Good understanding of data warehousing concepts and dimensional modeling.
n
Experience with workflow orchestration tools such as Cloud Composer (Airflow) is preferred.
n
Knowledge of version control systems such as Git.
n
Experience with performance tuning and optimization of large datasets.
n
Solid analytical and problem-solving skills.
n
n
📌 Gcp Data Engineer: Face To Face Hackathon On 19 Sep@ Chennai
🏢 HCLTech
📍 Chennai