19 Sep
|
HCLTech
|
Chennai
Position: GCP Data Engineer Experience: 5+ Years Location: Hybrid/Remote/Onsite Employment Type: Full-timeJob SummaryWe are seeking an experienced GCP Data Engineer with strong expertise in Google Cloud Platform (GCP), BigQuery, SQL, and PySpark. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing data processing workflows, and supporting enterprise analytics and reporting initiatives.Key ResponsibilitiesDesign, build, and maintain scalable ETL/ELT data pipelines on GCP.Develop and optimize data solutions using BigQuery for large-scale data warehousing and analytics.Create efficient data transformation workflows using PySpark.Write complex SQL queries, stored procedures, and performance-tuning scripts.Ingest data from multiple structured and unstructured sources into GCP environments.Implement data quality, validation, and monitoring frameworks.Collaborate with business stakeholders, analysts,
and data scientists to understand data requirements.Optimize query performance, partitioning, clustering, and cost management in BigQuery.Troubleshoot and resolve data pipeline and performance issues.Follow best practices for security, governance, and compliance within GCP.Required Skills5+ years of experience in Data Engineering.Strong experience with Google Cloud Platform (GCP).Expertise in BigQuery and advanced SQL.Hands-on experience with PySpark for data transformation and processing.Experience building ETL/ELT pipelines.Good understanding of data warehousing concepts and dimensional modeling.Experience with workflow orchestration tools such as Cloud Composer (Airflow) is preferred.Knowledge of version control systems such as Git.Experience with performance tuning and optimization of large datasets.Robust analytical and problem-solving skills.
📌 Gcp Data Engineer: Face To Face Hackathon On 19-Sep@ Chennai
🏢 HCLTech
📍 Chennai