We are looking for an exceptional Data Architect to help design, scale, and optimise the next generation of India's open-commerce data infrastructure. At ONDC, we process 10 TB of data daily, maintain 1 billion+ live entities, and handle 300K+ requests per second, operating at true internet scale. You will work at the heart of this system, shaping data platforms that meet all three Vs of big data: volume, velocity, and variety.

Responsibilities

- Architect and Evolve Modern Data Platforms: Design, optimise, and scale data lakehouse architectures across multi-cloud environments (AWS, GCP, Azure), supporting both ad-hoc analytics and batch workloads.

- Medallion and Lakehouse Design: Implement and evolve bronze-silver-gold (medallion) data pipelines using columnar formats (Parquet, ORC, Iceberg), ensuring cost-efficient, schema-evolution-friendly storage.
- Data Discovery and Schema Governance: Build and maintain central schema repositories and data discovery services leveraging technologies like AWS Glue, Hive Metastore, Apache Iceberg, and Delta Catalogues.
- Streaming Architecture: Architect and deploy real-time data streaming frameworks using Kafka or Pulsar, ensuring low-latency data flow, schema validation, and replayability.
- Performance and Cost Optimisation: Identify and implement cost-saving measures across data pipelines, data compression, columnar optimisation, storage tiering, and query performance tuning.
- Data Orchestration and Workflow Automation: Build and maintain orchestration frameworks using Airflow, Dagster, or Argo Workflows, ensuring observability, failure recovery, and lineage tracking.
- OLAP Systems and Query Acceleration: Design and tune analytical workloads using Snowflake, Redshift, ClickHouse, or Druid, supporting large-scale aggregation and real-time exploration.
- DevOps and Infrastructure as Code:



Collaborate with DevOps teams to define reproducible infrastructure using Terraform / CloudFormation / Pulumi. Deploy, monitor, and optimise Kubernetes-based data services.
- Natural Language Querying: Contribute to frameworks enabling natural-language analytics, integrating LLM-powered question-answer systems over structured data.

Requirements

- 8+ years of experience in data architecture, platform engineering, or distributed systems.
- Proven expertise in Spark, Snowflake, Redshift, and SQL-based data modelling.
- Hands-on experience with streaming (Kafka/Pulsar) and batch processing frameworks.
- Deep understanding of cloud-native and cloud-agnostic architectures.
- Practical experience implementing lakehouse/medallion models.
- Strong grasp of data lineage, cataloguing, governance, and schema evolution.
- Exposure to columnar formats (Parquet/ORC) and query engines (Presto/Trino/DuckDB).
- Familiarity with Kubernetes, Docker, and microservices-based data deployment.
- Excellent problem-solving, documentation, and cross-team collaboration skills.
- Experience in designing central schema and data discovery layers at scale.
- Prior exposure to large-scale public data networks (e. g., e-commerce, fintech, telecom).
- Understanding of AI/LLM-driven data access or semantic query layers.
- Contributions to open-source data infrastructure projects (nice to have).

Company Summary Open Network For Digital

Commerce (ONDC)



is a market-led initiative aimed at enabling interoperability in digital commerce. Based on the principles of openness, it aims to enable unbundling digital commerce, democratizing digital commerce, and unlocking value for all parts of digital commerce, as well as enabling innovation to unlock the next chapter of digital commerce. In India, more than 12 million sellers earn their livelihood by selling or reselling products and services.

However, only 15,000 of these sellers (0.125% of the total) have enabled e-commerce. E-retail has been out of reach for the majority of sellers, especially those from small towns and rural areas. ONDC recognizes the unique prospect to increase e-retail penetration from the existing 4.3% to its maximum potential in India.

Our mission is to dramatically increase e-commerce penetration in the country by enabling population-scale inclusion of all types and sizes of sellers. India has been a world leader in demonstrating the successful adoption of digital infrastructures at the population scale, such as UPI, AADHAAR, and more. ONDC (Open Network For Digital Commerce) is yet another tech-based initiative to transform the way e-commerce functions in the country by enabling e-commerce through an open protocol based on open-source specifications.

The initiative will not only facilitate the rapid adoption of e-commerce but also boost and strengthen the growth of startups in India. By facilitating scalable and cost-effective e-commerce through the open protocol, ONDC will empower startups to grow collaboratively.

Required Skills ['Amazon Redshift', 'AWS Glue', 'Data Analysis', 'Data Streaming', 'Data Warehousing', 'ETL', 'Hive', 'Kafka', 'Kubernetes', 'Pulsar', 'Snowflake', 'Spark', 'SQL']

Additional Information na

📌 Data Architect (Bawana)
🏢 HuntingCube
📍 Bawana