Location: Remote (Candidate must be available to collect assets from the client location)
Shift: 2:00 PM – 11:00 PM IST
Job Summary
We are seeking an experienced Senior Data Engineer (Technical Lead) to lead a Business-As-Usual (BAU) Data Engineering team responsible for maintaining, supporting, and enhancing production data pipelines on Google Cloud Platform (GCP) . The ideal candidate will be a hands-on technical leader with expertise in designing, optimizing, and troubleshooting large-scale data pipelines while mentoring team members and ensuring production stability.
Key Responsibilities
- Lead and mentor the Data Engineering team, providing technical guidance and best practices.
- Manage and support end-to-end production data pipelines from Data Lake to Data Warehouse .
- Troubleshoot and resolve production issues, pipeline failures, and data quality problems.
- Develop, optimize, and maintain ETL/ELT workflows using Python, SQL, and Apache Airflow .
- Perform SQL optimization, data validation, backfills, and workflow enhancements.
- Ensure smooth production deployments by following change management, testing, and rollback procedures.
- Monitor pipeline performance and implement improvements to increase reliability and efficiency.
- Collaborate with cross-functional teams and provide overlap with US business hours when required.
- Drive continuous improvements through automation and process optimization.
Required Skills
- 10+ years of experience in Data Engineering.
- Robust expertise in SQL Server and advanced SQL.
- Hands-on experience with Python for data processing and automation.
- Strong experience with Apache Airflow/Cloud Composer .
- Extensive knowledge of Google BigQuery .
- Experience with Hadoop and Data Lake architectures.
- Strong understanding of Data Warehousing concepts, including Dimensions, Facts, and SCD Type 1/2.
- Experience in production support, incident management, and change control.
- Excellent leadership, communication, and stakeholder management skills.
Preferred Skills
- Experience with Google Cloud Platform (GCP) services.
- Knowledge of Kimball Data Warehouse Methodology .
- Experience integrating data from Salesforce .
- Prior experience leading offshore or distributed Data Engineering teams.
📌 Senior Data Engineer 10+ yrs (India)
🏢 MindBrain
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.