Role: Backend Engineer – (Python, Rust & AI Services)
Experience: 3+yrs
Work Mode: Remote
Notice period: Only Immediate - 15days

THE OPPORTUNITY

We are building a new service to collect and normalize data catalogs from diverse data sources — including relational databases, data lakes, data warehouses, and streaming systems — and expose them to an AI agent that dynamically constructs and routes queries to the appropriate source. This is a greenfield initiative that requires robust engineering judgment, a systems-thinking mindset, and experience shipping production-grade services.
You will be a core contributor on this project, working from architecture to implementation — designing ingestion pipelines, building the catalog API layer, and collaborating with the AI/ML team to surface the right metadata signals for intelligent query generation.

RESPONSIBILITIES
Design, build, and operate a highly available data catalog collection service that ingests schema and metadata from heterogeneous data sources (RDBMS, data lakes, streaming platforms, APIs)




Develop robust data pipelines for catalog extraction, normalization, lineage tracking, and semantic tagging to power AI-driven query routing
Build and maintain RESTful and/or gRPC APIs that expose catalog data to an AI query agent
Deploy and manage services on Kubernetes (K8s), including helm chart authoring, autoscaling configuration, and multi-cluster operations
Ensure service reliability through SLO definition, circuit breakers, retry logic, and distributed tracing
Integrate with open-source and cloud-native technologies including Apache Kafka, Spark, dbt, Apache Atlas, or OpenMetadata
Collaborate with AI/ML engineers to design and iterate on the metadata schema and query routing interface
Participate in on-call rotations and contribute to incident response, postmortems, and reliability improvements
Contribute to CICD pipelines, infrastructure-as-code (Terraform / Helm), and automated testing frameworks

QUALIFICATIONS
R

📌 Software Engineer – (India)
🏢 SysTechCorp
📍 India