Search & Platform Engineer

Experience: 5+ Years

Contract: Remote Contract

Role Overview

We are looking for an experienced Search & Platform Engineer to own and enhance production-grade clinical search infrastructure for a RAG-based medical information platform. The role involves hands-on backend engineering, OpenSearch infrastructure, intelligent query pipelines, data ingestion, and production reliability.

You will work closely with the AI Evaluation & RAG Engineer, focusing on search infrastructure, retrieval quality, data pipelines, and platform observability.

Key Responsibilities

Search Infrastructure & Retrieval

- Design, manage, and optimize OpenSearch indices, mappings, custom analyzers, and query DSL.
- Implement and tune BM25 lexical, kNN vector, and hybrid RRF search.
- Maintain intelligent query pipelines, including spell correction, abbreviation expansion, query routing, and multi-intent decomposition.
- Manage multilingual indices and embedding-based vector search.
- Own index versioning, re-indexing, and rollback workflows.

Data Ingestion & Pipelines
- Develop and maintain end-to-end ingestion pipelines from XML content (LEGO CMS) to OpenSearch lexical and vector indices.
- Ensure ingestion reliability, data quality, and index consistency.
- Manage synonym configurations and support SNOMED CT ontology currency.
- Perform data transformation and indexing for structured and semi-structured content.

Backend Engineering & API Development
- Maintain and enhance FastAPI services using Python 3.10+ / 3.11+.
- Implement asynchronous programming, API key authentication, rate limiting, and structured JSON logging.
- Develop and maintain REST APIs for unified search, autocomplete, mobile, and SNOMED endpoints.
- Write and maintain automated tests using pytest.

Reliability & Observability
- Monitor and troubleshoot production search and ingestion pipelines.
- Identify and respond to degradation across rewrite, route, embed, decompose, and generate stages.
- Implement observability using Prometheus metrics,



correlation IDs, and alerting.
- Support graceful degradation and production incident resolution.

Cloud, DevOps & Deployment
- Support Docker and Kubernetes deployments across development, staging, and production environments.
- Maintain GitHub Actions CI/CD pipelines and CI-gated test suites.
- Collaborate on AWS infrastructure, including ECS/EKS, IAM, Lambda, CloudWatch, and API Gateway.

Required Skills & Qualifications
- 5+ years of experience in backend engineering, search engineering, or platform development.
- Strong production-grade Python experience (3.10+), preferably Python 3.11.
- Hands-on experience with OpenSearch or Elasticsearch , including index design, mappings, custom analyzers, BM25 tuning, query DSL, and aggregations.
- Practical experience with vector search and hybrid retrieval, including kNN/ANN indices, embedding pipelines, and RRF.
- Experience designing and maintaining data ingestion and transformation pipelines.
- Strong knowledge of FastAPI, asynchronous programming, and pytest.
- Experience supporting production systems, observability, and reliability engineering.
- Experience with Docker, Kubernetes, and CI/CD workflows.

Positive to Have
- AWS experience (IAM, ECS/EKS, CloudWatch, Lambda, API Gateway).
- Multilingual search and language-specific analyzers.
- Familiarity with SNOMED CT or clinical ontologies.
- React/Next.js frontend integration through REST APIs.
- Knowledge of pydantic-settings and uv.
- Experience in healthcare, medical search, or RAG-based platforms.

Technical Stack

CategoryTechnologies

Search & Vector

OpenSearch, BM25, kNN, RRF, text-embedding-3-large

Backend

Python 3.11, FastAPI, Pydantic Settings, uv

Infrastructure

Docker, Kubernetes, AWS ECS/EKS

CI/CD

GitHub Actions

Observability

Prometheus, JSON Logging, Correlation IDs

Data Ingestion

XML, LEGO CMS, Lexical & Vector Indexing

Clinical Data

SNOMED CT

API

REST, Unified Search Endpoints

Contract Details

- Experience: 5+ Years
- Contract Duration: 6-12 Months
- Work Mode: Remote
- Employment Type: Contract

📌 Search & Platform Engineer (5+ yrs) (India)
🏢 MindBrain
📍 India