Job description:
KEY RESPONSIBILITIES
· Design and own multi-stage ingestion pipelines — handling HTML, PDF, and image sources with layout parsing, metadata extraction, and vector storage
· Architect RAG systems with hybrid search (BM25 + semantic), document versioning, and cross-reference resolution
· Build production-grade Fast API services with typed response envelopes, Open API compliance, and Langfuse tracing integration
· Engineer prompt systems — structured prompts, prompt versioning, few-shot strategies, and judge-based evaluation
· Integrate and manage LLM routing via Lite LLM: model fallback, cost control, and per-route configuration
· Design agentic workflows using Lang Graph: multi-step retrieval, tool use, and conditional branching
· Build and maintain knowledge graphs in Nebula Graph / Neo4j — entity extraction, relationship modelling, and domain ontology alignment
· Implement graph-augmented retrieval (Graph RAG) — combining vector search with graph traversal to surface contextually connected information beyond chunk-level retrieval




· Own entity linking and co-reference resolution pipelines that connect ingested documents to graph nodes
· Lead RAG evaluation initiatives — define metrics, build eval datasets, and run regression cycles
· Drive observability standards — tracing, cost attribution, and latency profiling via Langfuse
· Collaborate on K8s deployment patterns for AI services: resource limits, GPU scheduling, and health probes
· Mentor junior developers and conduct code and prompt reviews
REQUIRED SKILLS
· Python (5+ years) — async, concurrency patterns, production packaging
· Deep understanding of RAG — hybrid retrieval, reranking, chunking strategies, embedding model selection
· Rapid API — dependency injection, middleware, background tasks, async patterns
· Prompt engineering — structured prompting, chain-of-thought, evaluation-driven iteration
· LLM API integration — Open AI-compatible APIs, AWS Bedrock, or similar
· Vector DB expertise — W

📌 Generative ai engineer (Pune)
🏢 Accion Labs
📍 Pune