Hiring: Senior Data Engineer (Technical Lead) – GCP Data Engineering

? Location: Remote (Laptop/Assets to be collected from Mumbai, Bengaluru, Chennai)

? Employment Type: Contract

? Shift: 2:00 PM – 11:00 PM IST (Overlap with US Working Hours)

? Experience: 10+ Years

Job Summary

We are looking for an experienced Senior Data Engineer (Technical Lead) to lead a Business-As-Usual (BAU) Data Engineering team responsible for maintaining, optimizing, and enhancing production data pipelines on Google Cloud Platform (GCP).

This is a hands-on leadership role where you'll mentor a team while actively contributing to development, troubleshooting production issues, optimizing ETL workflows, and ensuring reliable data movement from Data Lake → Dimensions/Facts → Data Warehouse.

Key Responsibilities

Lead and mentor an offshore Data Engineering team, ensuring operational excellence and knowledge sharing.

Own the stability, reliability, and performance of production data pipelines on GCP.

Troubleshoot, debug, and resolve complex production incidents and pipeline failures.

Perform SQL fixes, DAG modifications, data backfills, and production validations.

Manage data flow architecture from Data Lake to Dimensional Models and Data Warehouse.

Implement robust change management processes with testing, deployment evidence, and rollback strategies.

Optimize Airflow DAGs and automate repetitive operational tasks using Python.

Improve pipeline performance,



reliability, and cost efficiency in BigQuery.

Collaborate with cross-functional teams and provide overlap with US business hours when required.

Drive continuous improvements by eliminating recurring production issues and reducing technical debt.

Mandatory Skills

SQL Server

Python

Apache Airflow / Cloud Composer

Hadoop

Google BigQuery

Data Lake Architecture

Google Cloud Platform (GCP)

Data Warehouse Concepts

ETL Development

Production Support

Required Experience

10+ years of Data Engineering experience.

Proven experience working as a Technical Lead or Team Lead.

Strong hands-on expertise with Google BigQuery.

Experience with Slowly Changing Dimensions (SCD Type 1 & Type 2).

Knowledge of BigQuery partitioning, clustering, and query optimization.

Robust experience building and maintaining Apache Airflow DAGs.

Proficiency in Python for automation, scripting, and API integrations.

Experience handling production support, incident management, and ITIL-based change control.

Excellent troubleshooting and debugging skills.

Strong communication and leadership abilities.

Preferred Skills

Kimball Data Warehouse Methodology (Star Schema, Facts & Dimensions)

Experience with Salesforce data integration

Exposure to Cloud Composer

Experience working with global/offshore engineering teams

Data pipeline optimization and automation

📌 Senior Data engineer (10+ yrs) (India)
🏢 MindBrain
📍 India