We are looking for a talented GCP Data Engineer with 2-5 years of experience in designing, building, and maintaining scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate should have expertise in BigQuery, Dataflow, ETL/ELT processes, and cloud-based data warehousing solutions.
Key Responsibilities
- Design and develop scalable data pipelines using GCP services.
- Build and maintain ETL/ELT processes for structured and unstructured data.
- Develop and optimize data models and data warehouse solutions using BigQuery.
- Ingest data from various sources into GCP environments.
- Work with large-scale datasets and ensure data quality, integrity, and performance.
- Monitor, troubleshoot, and optimize data processing workflows.
- Collaborate with data analysts, data scientists, and business stakeholders.
- Implement data governance,
security, and compliance best practices.
- Automate data workflows and deployments using CI/CD practices.
- Required Skills
- 2-5 years of experience in Data Engineering.
- Strong experience with Google Cloud Platform (GCP).
- Hands-on experience with:
- BigQuery
- Dataflow
- Cloud Composer (Airflow)
- Pub/Sub
- Cloud Storage
- Dataproc
- Solid SQL skills and query optimization experience.
- Experience with Python, PySpark, or Java.
- Knowledge of ETL/ELT frameworks and data warehousing concepts.
- Experience working with batch and real-time data processing.
- Familiarity with Git and CI/CD tools.