26 Sep
|
Vysystems
|
India
We are seeking an experienced GCP Data Engineer with solid expertise in BigQuery, Oracle Exadata/PLSQL, PySpark, Python, Terraform, and Airflow. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and cloud-based data solutions while supporting integration between Oracle and Google Cloud environments.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Python, PySpark, and Airflow.
Develop and optimize data solutions on Google Cloud Platform (GCP), with strong hands-on experience in BigQuery.
Work with Oracle Exadata databases and develop complex PL/SQL procedures, packages, functions, and SQL queries.
Build and optimize large-scale data processing workflows using PySpark.
Develop reusable Python scripts and frameworks for data processing, automation, and integration.
Create and manage infrastructure using Terraform following Infrastructure-as-Code best practices.
Design, schedule, monitor, and troubleshoot data workflows using Apache Airflow.
Optimize BigQuery queries, data models, partitioning, clustering, and overall data-processing performance.
Implement data quality, validation, monitoring, logging,
and error-handling mechanisms.
Collaborate with data architects, developers, analysts, and business stakeholders to understand requirements and deliver reliable data solutions.
Follow cloud security, governance, access-control, and data-management best practices.
Required Skills
Solid hands-on experience with GCP
Excellent experience with Google BigQuery
Strong experience with Oracle Exadata
Advanced PL/SQL and SQL development skills
Strong programming experience in Python
Hands-on experience with PySpark
Strong experience with Apache Airflow
Experience with Terraform / Infrastructure as Code
Experience building ETL/ELT and data pipelines
Experience with Oracle-to-GCP data migration/integration
Solid understanding of data warehousing and data engineering concepts
Preferred Skills
Experience with GCP data services such as Cloud Storage, Dataflow, Pub/Sub, Dataproc, and Cloud Composer
Experience with CI/CD and DevOps practices
Knowledge of cloud security and IAM
Experience with large-scale enterprise data migration projects
Experience working in Agile development environments
📌 Gcp Data Engineer Bengaluru (India)
🏢 Vysystems
📍 India