07 Sep
|
Weekday AI
|
India
This role is for one of Weekday’s clients
Min Experience: 7+ years
Location: India
JobType: full-time
We are looking for a hands-on Platform Engineer – Data (SDE-3 / Staff) to take ownership of a large-scale, billion-row shared data platform and help scale it from its current state to the next level of reliability, performance, and usability.
This is a data platform engineering role, not a business ETL or analytics-pipeline delivery position. You will design, build, and operate the foundational systems that product and engineering teams rely on. The role requires solid distributed-systems expertise, production engineering skills, and the ability to drive architecture while remaining deeply involved in coding and operations.
Requirements
What You’ll Own
- Build and evolve open-lakehouse foundations using technologies such as Apache Iceberg, Delta Lake, or Apache Hudi, including table lifecycle management, partitioning, data layout, compaction, schema evolution, catalog management, and query operations.
- Design and operate batch and streaming ingestion systems,
including CDC, data contracts, deduplication, checkpointing, replay, recovery, and failure handling.
- Develop platform services, APIs, and self-service capabilities that enable engineering and product teams to consume and manage data independently without creating unnecessary dependencies on a central platform team.
- Build and manage orchestration and workload execution systems across Kubernetes and workflow technologies such as Prefect, Argo, or Airflow.
- Establish robust metadata, lineage, governance, data quality, and observability capabilities across the platform.
- Own production reliability and operational excellence, including incident response, SLAs, data freshness, performance and cost optimization, capacity planning, and recovery improvements.
- Establish engineering standards and architectural patterns that enable the platform to scale across teams and workloads.
What We’re Looking For
- T
📌 Platform Engineer (India)
🏢 Weekday AI
📍 India