15 Nov
|
HCLTech
|
Hyderabad
## Job highlights
- 7+ years IT experience with 3+ years in GCP, expertise in BigQuery, SQL, Python/PySpark, DBT or Airflow and Dataflow
- Design and maintain scalable ETL/ELT pipelines, optimize BigQuery data solutions, develop data transformations, orchestrate workflows, ensure data quality and compliance Role: Senior GCP Data Engineer
Experience:
7+ Years
Location:
Hyderabad / Chennai / Bangalore Employment Type: Permanent Job Summary We are looking for an experienced GCP Data Engineer with 7+ years of experience in designing, developing, and optimizing large-scale data pipelines and cloud-native data solutions on Google Cloud Platform (GCP). The ideal candidate should possess solid expertise in BigQuery, SQL, Python/PySpark, and modern data engineering technologies. Mandatory Skills Option 1:
- Google BigQuery
- Advanced SQL
- Python / PySpark
- DBT (Data Build Tool) OR Option 2:
- Google BigQuery
- Advanced SQL
- Apache Airflow
- Google Dataflow
- Google Dataproc
- Python / PySpark
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines on GCP.
- Build and optimize data solutions using BigQuery for analytics and reporting.
- Develop data transformation frameworks using DBT, Python, and PySpark.
- Orchestrate workflows using Airflow and automate data processing pipelines.
- Implement batch and real-time data processing using Dataflow and Dataproc.
- Collaborate with business stakeholders, architects, and analytics teams to deliver data-driven solutions.
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
- Ensure data quality, governance, security, and compliance standards are followed. Required Qualifications
- 7+ years of overall IT experience with strong Data Engineering expertise.
- Minimum 3+ years of hands-on experience in Google Cloud Platform (GCP).
- Strong proficiency in SQL and Python/PySpark.
- Experience working with large-scale structured and unstructured datasets.
- Good understanding of Data Warehousing and Data Lake concepts.
- Hands-on experience with CI/CD, Git, and DevOps practices.
- Experience in Agile development methodologies.
- Excellent communication and stakeholder management skills. Preferred Certifications
- Google Professional Data Engineer Certification
- Google Associate Cloud Engineer Certification Notice Period
- Immediate Joiners preferred.
- Candidates serving up to 30 days notice period are highly preferred. Good to Have
- GCP Migration Projects
- Data Modeling
- Streaming Data Pipelines
- Terraform / Infrastructure as Code
- Cloud Composer
- Looker / BI Reporting Tools
📌 Gcp Data Engineer (Hyderabad)
🏢 HCLTech
📍 Hyderabad