25 Sep
|
Vysystems
|
Bengaluru
25 Sep
Vysystems
Bengaluru
We are seeking an experienced GCP Data Engineer with strong expertise in BigQuery, Oracle Exadata/PLSQL, PySpark, Python, Terraform, and Airflow. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and cloud-based data solutions while supporting integration between Oracle and Google Cloud environments.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Python, PySpark, and Airflow.
- Develop and optimize data solutions on Google Cloud Platform (GCP), with strong hands-on experience in BigQuery.
- Work with Oracle Exadata databases and develop complex PL/SQL procedures, packages, functions, and SQL queries.
- Build and optimize large-scale data processing workflows using PySpark.
- Develop reusable Python scripts and frameworks for data processing, automation, and integration.
- Create and manage infrastructure using Terraform following Infrastructure-as-Code best practices.
- Design, schedule, monitor, and troubleshoot data workflows using Apache Airflow.
- Optimize BigQuery queries, data models, partitioning, clustering, and overall data-processing performance.
- Implement data quality, validation, monitoring, logging,
and error-handling mechanisms.
- Collaborate with data architects, developers, analysts, and business stakeholders to understand requirements and deliver reliable data solutions.
- Follow cloud security, governance, access-control, and data-management best practices.
Required Skills
- Strong hands-on experience with GCP
- Excellent experience with Google BigQuery
- Strong experience with Oracle Exadata
- Advanced PL/SQL and SQL development skills
- Strong programming experience in Python
- Hands-on experience with PySpark
- Strong experience with Apache Airflow
- Experience with Terraform / Infrastructure as Code
- Experience building ETL/ELT and data pipelines
- Experience with Oracle-to-GCP data migration/integration
- Solid understanding of data warehousing and data engineering concepts
Preferred Skills
- Experience with GCP data services such as Cloud Storage, Dataflow, Pub/Sub, Dataproc, and Cloud Composer
- Experience with CI/CD and DevOps practices
- Knowledge of cloud security and IAM
- Experience with large-scale enterprise data migration projects
- Experience working in Agile development environments
📌 GCP Data Engineer (Bengaluru)
🏢 Vysystems
📍 Bengaluru