11 Sep
|
MindBrain
|
Bengaluru
11 Sep
MindBrain
Bengaluru
GCP Test EngineerExperience: 8+ Years
Location: Remote
Shift Timing: 2:00 PM – 11:00 PM IST
Work Arrangement: Remote Working
Laptop Collection: Candidates must be able to collect the company laptop from Mumbai, Bangalore, or Chennai office locations.
Job OverviewWe are looking for an experienced GCP Test Engineer with 8+ years of experience in data testing, data quality assurance, and cloud-based data pipeline validation. The ideal candidate should have robust hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery, Dataflow, Cloud Composer, and Google Cloud Storage (GCS).
The candidate will be responsible for validating end-to-end data pipelines, performing source-to-target reconciliation, testing data transformations and warehouse loads, and ensuring the accuracy, completeness, and integrity of data across cloud environments.
Key Responsibilities
- Perform end-to-end validation of GCP-based data pipelines involving Cloud Composer, Dataflow, BigQuery, and GCS.
- Analyze complex BigQuery SQL queries for source-to-target reconciliation, data quality validation, and transformation testing.
- Validate historical and incremental data loads across cloud-based data warehouse environments.
- Execute comprehensive Data Quality Assurance (DQA) checks covering completeness, accuracy,
consistency, uniqueness, freshness, and referential integrity.
- Validate Apache Airflow DAGs running through Cloud Composer, including dependencies, scheduling, workflow execution, monitoring, and failure analysis.
- Perform batch and streaming data validation for Dataflow pipelines and investigate processing anomalies and data discrepancies.
- Validate dimensional and fact table loads, including surrogate key generation and Slowly Changing Dimensions (SCD) Type 1 and Type 2 implementations in BigQuery.
- Develop and execute SQL-based validation frameworks for automated audit reconciliation and data validation.
- Perform source-to-target data reconciliation and identify discrepancies across multiple data processing stages.
- Collaborate with Data Engineering teams to troubleshoot data issues, conduct root cause analysis (RCA), and ensure production data integrity.
- Participate in Agile ceremonies, defect triage meetings, sprint planning, release validation, and production deployment verification.
- Prepare and maintain test scenarios, test cases, validation scripts, defect reports, and data quality documentation.
- Support production validation and post-deployment verification activities.
📌 Senior GCP Test Engineer with (8+ year) (Bengaluru)
🏢 MindBrain
📍 Bengaluru