Senior Data Engineer / Data Platform Lead

The Role

Every number a customer argues about.

Architecture is still open and yours to decide and defend: warehouse shape, table format, orchestration, where the streaming boundary sits against change capture or a tighter batch cadence, and how datasets are tiered with real service levels behind them.

This is
not an Analytics Engineer role
. They decide what a term means; you decide whether the number is computed correctly, arrives on time, and can bear the inference drawn from it.

If a metric means two different things in two places, that is theirs. If it means the right thing but is stale or irreproducible, it is yours.

What You Would Actually Be Doing

Own the Event Pipeline

Own the event pipeline behind shipment milestones: late arrivals, corrections that restate a milestone recorded three days ago, and the gap between event time and ingest time.

Define how a restatement propagates to something a customer has already seen.

Build for Agent-Grade Serving





Make the serving path valuable enough for an agent to depend on — with a stated freshness target per dataset and a read path whose
p99 you know
.

Because when a run stalls waiting for a number, a workflow with money attached stalls too.

Make Data Quality Fail, Not Warn

Build data quality as
failing checks
, not dashboards:
- Null rates
- Referential integrity breaks
- Duplicate milestones
- Distribution shifts when a partner changes a field

A check that only warns is a check nobody reads.

Enforce Tenant Isolation

Enforce tenant isolation at the data layer and assert it through tests.

Contract rates are commercially sensitive between competitors who may share the same forwarders.

Own Expensive Backfills

Plan backfills that cost real money.

A reprocess across
30+ countries of historical data
has a bill and a blast radius. You own both.

Apply Statistical Judgement

Bring statistical rigour to decisions.

Know what you can and cannot claim from observational d

📌 Data Scientist (Bengaluru)
🏢 GoComet
📍 Bengaluru