We are looking for an experienced GCP Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data solutions on Google Cloud Platform.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines using GCP services.
- Build and maintain data warehouses and data lakes.
- Develop data ingestion frameworks for batch and real-time processing.
- Create optimized BigQuery data models and ensure data quality.
- Work closely with business stakeholders, data analysts, and data scientists.
- Implement monitoring, troubleshooting, and performance tuning for data pipelines.
- Ensure security, governance, and compliance standards are followed.
Required Skills
- Strong experience in Google Cloud Platform (GCP).
- Hands-on experience with:
- BigQuery
- Dataflow
- Pub/Sub
- Cloud Composer (Airflow)
- Cloud Storage
- Cloud Functions
- Robust programming skills in Python.
- Expertise in SQL and data modeling.
- Experience in ETL/ELT development and optimization.
- Knowledge of CI/CD, Git, and Agile methodologies.
- Experience with real-time data processing is preferred.