Lead Data Engineer (Bengaluru)

Lead Data Engineer (Bengaluru)

30 Oct
|
Woolworths Group International
|
Bengaluru

30 Oct

Woolworths Group International

Bengaluru

Lead Data Engineer Woolworths Group India is partnering exclusively with Zinnov Group to recruit for this position.

About the role
We are seeking a Lead GCP Data Engineer to take technical ownership of our data products, and drive technical direction across our cloud data infrastructure. In this role, you will transform complex, multi-system data landscapes into a unified, high-performance platform that powers real-time analytics, machine learning, and reporting. You will balance deep technical execution with platform strategy, cost optimization, operational rigor, and squad leadership—mentoring junior and mid-level data engineers while enabling cross-functional teams. Additionally, you will drive operational excellence by enforcing Information Management (IM) CI/CD release controls, managing formal Change Requests (CRs), and ensuring all data pipelines and products are seamlessly transitioned to operational support teams with enterprise-standard runbooks and documentation. What you’ll do
• Technical Leadership & Mentorship: Provide technical leadership, code reviews, and guidance to data engineering squads; enforce high standards for code quality, design patterns, and engineering practices.
• Pipeline Design: Design and oversee production-ready batch and real-time ETL/ELT pipelines using BigQuery, Cloud Dataflow (Apache Beam), Pub/Sub, Cloud Composer (Airflow), Dataproc, and Cloud Storage (GCS).
• Build reusable ingestion frameworks and configuration-driven pipeline patterns to accelerate onboarding new data sources without writing custom code every time
• Data Modeling & Strategy: Design scalable enterprise dimensional data models optimised for high-volume BigQuery analysis and downstream machine learning models.
• Proactively monitor and optimise Data Products Establish standards for data quality, lineage, access security, alerting, and observability across the data stack.
• Drive technical code reviews, set engineering standards, and mentor junior and mid-level data engineers to raise overall team capability.
• Lead CI/CD workflow implementation, Terraform IaC infrastructure provisioning, container orchestration (Docker), and automated testing frameworks across non-prod and prod environments.
• Drive cross-functional UAT coordination, Support business release sign-offs, and technical alignment with Product Managers, SME, Architects,



and Delivery Managers.
• Demonstrated ability to harness artificial intelligence to resolve complex data challenges; prior experience architecting AI solutions is highly desirable.
• Governance & Cost Optimization: Monitor, optimise, and control GCP resource consumption, BigQuery slot utilisation, and adhere strictly to enterprise security and privacy standards.
• Raise required Change Requests (CRs) and direct release management activities in full alignment with Information Management (IM) CI/CD process controls and governance protocols.
• Build, review, and maintain comprehensive operational support documentation, system runbooks, and handover artifacts to support transition to the IM support team, ensuring all documentation meets required enterprise standards. What you’ll bring
•

Experience:
6+ years in software/data engineering with 4+ years of dedicated experience architecting and operating enterprise-scale solutions on Google Cloud Platform (GCP).
• Advanced GCP Expertise: Deep technical mastery of BigQuery architecture (partitioning, clustering, slot management), Cloud Composer/Airflow, Dataflow (Apache Beam), Pub/Sub, Dataproc, GCS, and IAM security models.
• Software Engineering & Languages: Expert-level Python and SQL skills, clean code paradigms, unit/integration testing, Docker, Git, Terraform (IaC), and automated CI/CD pipelines.
• Technical Leadership: Demonstrated ability to lead technical delivery within squad environments, conduct architecture reviews, mentor mid/junior engineers, and drive technical decision-making.
• Infrastructure & Automation: Hands-on experience with Terraform or Google Cloud Deployment Manager for Infrastructure-as-Code (IaC), along with robust enterprise CI/CD pipelines.
• Enterprise Data Architecture: Strong expertise in enterprise data warehouse design, data lake architecture, streaming frameworks, Semantic modeling Layers, Looker, and metadata management.
• Troubleshooting & Problem Solving: Solid diagnostic,



debugging, and query performance tuning skills across distributed data environments.
• Communication: Clear written and verbal communication skills within distributed offshore/onshore team environments.
• Certifications (Preferred): GCP Professional Data Engineer or GCP Professional Cloud Architect. What you’ll experience
• Be a part of Australia’s largest retailer
• 20 days annual leave
• A flexible approach to work
• Premium insurance coverage for you and your dependants Everyone belongs at Woolworths Group Diversity, equity, inclusion, and belonging are key to realising our purpose of better together for a better tomorrow. We recognise the value our team’s diversity brings to our business, customers, and communities and that teams with diverse experiences and backgrounds enrich our group and are better able to innovate and solve problems. As one of the largest employers in Australia and New Zealand, we aim to create a truly inclusive workplace where everyone feels that they belong, can be their best selves, and reach their full potential. We encourage all candidates to apply; please let us know in your application if we can support you with any adjustments in the hiring process. Your Personal Data By submitting your application, you acknowledge and consent to Zinnov Management Consulting Private Limited and its subsidiaries (Zinnov) and/or Woolworths Group Limited and its subsidiaries (Woolworths Group) collecting, processing and disclosing your personal information, including any sensitive personal information provided by you, for the purposes of managing the recruitment process, assessing your suitability for employment, communicating with you regarding your application, and, where appropriate, considering you for future employment opportunities, to the extent relevant. If your application is successful, Zinnov and/ or Woolworths Group will also use your personal information, including sensitive personal information, for managing your ongoing working relationship. Your personal information will be handled, in accordance with applicable privacy laws. To learn more about how we collect, use, disclose and safeguard your personal information, including your privacy rights, please refer to the Zinnov Privacy Policy and Woolworths Group Team Member Privacy Notice.

📌 Lead Data Engineer (Bengaluru)
🏢 Woolworths Group International
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer (bengaluru) / bengaluru