Lead Data Services Engineer (Bengaluru)

Lead Data Services Engineer (Bengaluru)

30 Oct
|
Woolworths Group International
|
Bengaluru

30 Oct

Woolworths Group International

Bengaluru

Lead Data Services Engineer Woolworths Group India is partnering exclusively with Zinnov Group to recruit for this position.

About the role
• We are seeking a Lead Data Services Engineer to take end-to-end technical ownership of our enterprise data platform, drive distributed systems architecture, and establish engineering standards across our data and cloud infrastructure.
• In this role, you will bridge the gap between core software engineering, distributed systems, and modern data platforms—transforming complex, multi-system data landscapes into scalable, low-latency, and event-driven data platforms.
• You will balance technical execution with platform strategy, cost optimisation, software reliability engineering (SRE), AI solution integration, and squad leadership—mentoring junior and mid-level engineers while enabling cross-functional squads to self-serve through unified tooling.
• Additionally, you will drive operational excellence by enforcing Information Management (IM) CI/CD release controls, managing formal change requests, and ensuring all platform services are seamlessly transitioned to operational support teams with enterprise-standard runbooks and documentation What you’ll do 1. Product Vision & Strategic Delivery
• Product-Focused Data Services: Define, champion, and deliver the strategic product vision for core Data Services, treating data infrastructure, pipelines, and APIs as robust internal software products with clear value propositions.
• Roadmap & Delivery Planning: Formulate and maintain quarterly engineering and capability roadmaps for Data Services, aligning feature releases, platform enhancements, and technical debt reduction with broader business priorities and product backlogs.
• Product Backlog Resolution: Move beyond classic data warehouse patterns to design and prototype low-latency data solutions that directly address and resolve key product backlogs. 2. Design
• Resilient Pattern Design: Design and build resilient, reusable batch, streaming, and event-driven data patterns across the Information Management (IM) Data Environment using GCP native services (BigQuery, Cloud Dataflow, Pub/Sub, Pub/Sub Lite, Cloud Run, GKE, Bigtable, Memorystore) and through active exploration of emerging technology capabilities.
• Lead multi-stage CI/CD workflow implementations (Cloud Build or GitHub Actions), Terraform IaC declarative infrastructure provisioning, container orchestration (GKE / Cloud Run), and automated testing frameworks across non-prod and prod environments. 3. Developer Enablement, Tooling & Standardisation
• Self-Service Engine Construction: Drive developer velocity by engineering reusable, configuration-driven ingestion engines, internal SDKs, and self-service tools that eliminate manual pipeline overhead across squads.
• Data Contracts & Repositories: Establish automated data contract validation, standardised schema repositories, and unified interface abstractions. 4. SRE, Data Governance & Operational Excellence
• Site Reliability Engineering (SRE):



Enforce SRE principles across all data flows—defining Service Level Objectives (SLOs), managing API latency SLAs, and implementing circuit breakers, retries, and distributed tracing.
• Governance & Observability: Proactively monitor, optimise, and secure data products by establishing enterprise standards for data quality, lineage, financial management (FinOps), access control, alerting, and fine-grained observability. 5. Squad Leadership & Technical Mentorship
• Engineering Cadence & Mentorship: Lead small, cross-functional engineering squads to maintain a disciplined weekly deployment and release cadence. Conduct technical code reviews, define enterprise coding standards, and actively mentor junior and mid-level data engineers.
• Cross-Functional Collaboration: Partner with Product Managers, Solution Architects, and Analytics teams to translate business requirements into clear, scalable data contracts. 6. AI & Advanced Analytics Solutions
• AI Solution Engineering: Harness artificial intelligence to solve complex data challenges and accelerate pipeline automation.
• Scalable Serving Infrastructure: Architect scalable serving patterns, GenAI infrastructure, and low-latency API abstractions across the IM landscape. 7. Quality Assurance & E2E Validation
• End-to-End Testing Strategy: Oversee and Automated end-to-end testing strategies—including Unit, Integration, Regression, and Performance testing. 8. Change Management, CI/CD & Service Transition
• IM CI/CD & Change Management: Raise required Change Requests (CRs) and direct release management activities in full alignment with IM CI/CD process controls and governance protocols.
• Service Transition & Documentation: Build, review, and maintain comprehensive operational support documentation, system runbooks, and handover artifacts to ensure a seamless transition of platform services to the IM support team according to required enterprise standards. What you’ll bring
• 6+ years of total software/data engineering experience, with 4+ years dedicated to architecting enterprise-scale solutions on GCP and 3+ years in a Senior or Tech Lead capacity.
• GCP & Distributed Systems Mastery: Deep technical mastery of BigQuery architecture, Cloud Composer/Airflow, Dataflow (stateful Beam processing), Pub/Sub & Pub/Sub Lite, Cloud Run, GKE, Memorystore (Redis), Bigtable, and IAM security models.
• Systems Programming Languages: Expert-level proficiency in Python and Go (Golang) or Java/Scala for high-concurrency systems design, alongside advanced SQL and BigQuery performance tuning.
• Product & Platform Mindset: Proven track record treating data infrastructure as a product,



managing engineering roadmaps, and establishing self-service developer tooling.
• Modern Architecture & Serving Patterns: Deep knowledge of microservices, event-driven topologies, gRPC/Protobuf, Async I/O, Schema Evolution, Lakehouse serving patterns, and Data Vault modeling.
• Software Engineering, IaC & Containers: Deep hands-on experience with Terraform (IaC), multi-stage Docker builds, Kubernetes/GKE container orchestration, Git, and robust CI/CD workflows (Cloud Build or GitHub Actions).
• SRE & Governance: Practical experience enforcing SRE frameworks, SLOs, API latency SLAs, distributed tracing, alerting, data lineage, and FinOps slot management.
• Service Transition & Governance: Proven ability to author high-quality support documentation and runbooks, manage IM CI/CD release controls, and transition complex solutions to operational support teams.
• Mandatory Certifications: Google Cloud Professional Data Engineer or Google Cloud Professional Cloud Architect. What you’ll experience
• Be a part of Australia’s largest retailer
• 20 days annual leave
• A flexible approach to work
• Premium insurance coverage for you and your dependants Everyone belongs at Woolworths Group Diversity, equity, inclusion, and belonging are key to realising our purpose of better together for a better tomorrow. We recognise the value our team’s diversity brings to our business, customers, and communities and that teams with diverse experiences and backgrounds enrich our group and are better able to innovate and solve problems. As one of the largest employers in Australia and Recent Zealand, we aim to create a truly inclusive workplace where everyone feels that they belong, can be their best selves, and reach their full potential. We encourage all candidates to apply; please let us know in your application if we can support you with any adjustments in the hiring process. Your Personal Data By submitting your application, you acknowledge and consent to Zinnov Management Consulting Private Limited and its subsidiaries (Zinnov) and/or Woolworths Group Limited and its subsidiaries (Woolworths Group) collecting, processing and disclosing your personal information, including any sensitive personal information provided by you, for the purposes of managing the recruitment process, assessing your suitability for employment, communicating with you regarding your application, and, where appropriate, considering you for future employment opportunities, to the extent relevant. If your application is successful, Zinnov and/ or Woolworths Group will also use your personal information, including sensitive personal information, for managing your ongoing working relationship. Your personal information will be handled, in accordance with applicable privacy laws. To learn more about how we collect, use, disclose and safeguard your personal information, including your privacy rights, please refer to the Zinnov Privacy Policy and Woolworths Group Team Member Privacy Notice.

📌 Lead Data Services Engineer (Bengaluru)
🏢 Woolworths Group International
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data services engineer (bengaluru) / bengaluru