Lead GCP Data Engineer Retail & Marketing Analytics

Organisation: Factspan Analytics

Client: Leading US Retail Enterprise
Work Model: Hybrid
Experience: 10+ years

Role Overview

Factspan is seeking a highly experienced Lead GCP Data Engineer to design, develop and optimise enterprise-scale data platforms supporting retail and marketing analytics. The role requires deep expertise in Google Cloud Platform, SQL and Python, along with strong knowledge of customer, campaign, digital, transaction, product and loyalty data.

The selected candidate will work with data engineering, analytics, marketing, product and business teams to build reliable data products that enable customer insights, personalisation, campaign measurement, attribution, forecasting and executive reporting.

Key Responsibilities

- Architect and implement scalable batch and real-time data pipelines on GCP.
- Develop solutions using BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, Cloud Composer, Cloud Functions and Cloud Run.
- Build reusable ingestion and transformation frameworks using Python, SQL and Apache Beam.
- Design dimensional, relational and analytical data models for retail and marketing use cases.
- Integrate data from POS, e-commerce, loyalty, CRM, mobile applications, web analytics, media platforms and campaign systems.
- Build datasets supporting customer segmentation, campaign performance, attribution, conversion, retention, lifetime value and next-best-action analytics.
- Develop complex BigQuery SQL, stored procedures, views, incremental loads and reconciliation logic.
- Optimise BigQuery workloads through partitioning, clustering,



materialised views and query-performance tuning.
- Implement data quality controls, validation rules, audit frameworks, lineage and source-to-target reconciliation.
- Build orchestration workflows with Cloud Composer and manage dependencies, retries, alerts and recovery processes.
- Establish monitoring and logging using Cloud Monitoring, Cloud Logging and enterprise observability tools.
- Implement secure data access using IAM, service accounts, Secret Manager, encryption and governance standards.
- Support CI/CD, automated testing and infrastructure deployment using Git, Jenkins, GitLab, Cloud Build and Terraform.
- Lead technical design reviews, code reviews, root-cause analysis and production issue resolution.
- Mentor engineers and collaborate with US-based stakeholders across business and technology teams.

Required Skills

- 10+ years of data engineering experience.
- Advanced expertise in GCP, BigQuery, SQL and Python.
- Strong experience with Dataflow, Apache Beam, Pub/Sub, Composer and Cloud Storage.
- Excellent understanding of ETL/ELT, distributed processing, data modelling and performance optimisation.
- Robust retail and marketing analytics domain knowledge.
- Experience handling high-volume customer, transaction and behavioural datasets.
- Strong communication, architecture documentation and stakeholder-management skills.

Preferred Qualifications

Experience with Looker, Power BI, Tableau, Adobe Experience Platform, Customer Journey Analytics, dbt, Dataform, Spark, Kubernetes and Generative AIenabled data engineering is desirable.

📌 Lead GCP Data Engineer - Factspan Analytics (India)
🏢 Factspan Analytics
📍 India