30 Sep
|
Mastek
|
Bengaluru
Data Engineer – GCP
Experience: 5–8 years
Location: Bangalore
Employment Type: Full-time
Role Overview
We are looking for an experienced GCP Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The candidate should have robust hands-on experience with GCP data services, ETL/ELT development, SQL, and Python.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines on Google Cloud Platform.
- Build and maintain data pipelines using Cloud Dataflow, Dataproc, Cloud Composer, and BigQuery.
- Develop complex SQL queries and optimize BigQuery performance.
- Develop data processing solutions using Python and PySpark.
- Work with GCS, BigQuery, Pub/Sub, Dataflow, Dataproc, and Cloud Composer.
- Implement data ingestion from databases, APIs, files, and other sources.
- Develop data models and support data warehouse/lakehouse solutions.
- Implement data quality, validation,
monitoring, and error-handling mechanisms.
- Optimize pipeline performance and cloud resource utilization.
- Collaborate with data architects, analysts, developers, and business stakeholders.
- Follow security, governance, and CI/CD best practices.
Required Skills
- Strong hands-on experience with GCP data engineering services.
- Good knowledge of BigQuery, GCS, Dataflow, Dataproc, and Cloud Composer.
- Strong SQL and Python skills.
- Experience with PySpark and distributed data processing.
- Strong understanding of ETL/ELT concepts and data warehousing.
- Experience working with batch and/or real-time data pipelines.
- Knowledge of Git and CI/CD tools.
- Good understanding of data modeling, partitioning, and performance optimization.
📌 GCP Data Engineer (Bengaluru)
🏢 Mastek
📍 Bengaluru