15 Nov
|
Modern Ballistic
|
Bengaluru
15 Nov
Modern Ballistic
Bengaluru
Role Summary:
The architect designs and leads a privacy-preserving data platform that makes a large multi-market e-commerce client's customer data secure to use for analytics and AI. The architect leads our team on the ground (a data steward and data engineers) and works directly with the client's VP Data and data protection officer.
What the role does
- Designs the lakehouse on AWS: zone model, S3/Parquet layout, Iceberg tables, catalog and lineage.
- Writes the de-identification standard: which technique applies to which field (tokenise, generalise, suppress, drop) and the re-identification thresholds. Engineers implement it without the architect in the room.
- Designs integration from transactional systems (CDC vs batch) and the fail-closed rule that stops unclassified columns reaching the shared zone.
- Stays hands-on: the client expects architects to write PySpark and SQL, not only diagrams.
Client stack: S3, Athena, Glue Data Catalog, Lake Formation, Apache Iceberg, PySpark (EMR / EMR Serverless / Glue), Airflow; on-premise SQL Server warehouses; Snowflake in the wider estate.
All three must-haves are required.
Must-have:
- Hands-on AWS lakehouse: A named project in the last 3 years using S3 plus Athena or Glue, with Parquet partitioning and file sizing. Iceberg strongly preferred (Delta or Hudi acceptable if they can reason about Iceberg)
- Real anonymisation / de-identification work: Built it themselves tokenisation or pseudonymisation with keys, generalisation or suppression, k-anonymity. Encryption, access control or compliance audits alone do not count
- Designed a platform others built on: Owned design decisions (with alternatives rejected) and wrote a standard other engineers followed. About 8+ years total, 3+ in design authority
Nice to have:
- GDPR or African data-protection law (Nigeria NDPA, Kenya DPA)
- CDC from transactional systems (DMS, Debezium)
- Catalog and lineage tooling
- Cost engineering on a large lake
- Enough ML to know what training data needs
- Statistical disclosure control, research-data or health-data privacy background.
📌 Data Architect (Bengaluru)
🏢 Modern Ballistic
📍 Bengaluru