Home/Jobs/Senior Backend Engineer- AI Agents

Senior Backend Engineer- AI Agents

Level AI

Noida / Bengaluru

5+ years

1 day ago

$41.0K–55.4K/yr

Full-time

Hybrid

Skills Required LLM

RAG

Vector Database

Retrieval Systems

Agent Orchestration

AI

Distributed Systems

System Design

REST gRPC

Microservices

SQL

NoSQL

Data Modeling

Docker

Description Level AI is hiring a Senior Backend Engineer to build scalable backend systems for AI Agents in enterprise environments. The role focuses on real-time, production-grade AI infrastructure and agentic systems.

Company: Level AI

Role: Senior Backend Engineer- AI Agents

Location: Noida / Bangalore

Experience

- 5+ years of experience in backend engineering, distributed systems, or platform engineering
- Experience building high-scale, production-grade backend systems
- Experience designing systems for real-time processing, streaming, or event-driven architectures
- Strong understanding of API design (REST, gRPC) and microservices architectures
- Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
- Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
- Strong fundamentals in system design, concurrency, and performance optimization

Responsibilities

- Design and build scalable backend systems powering AI Agents in real-time enterprise environments
- Develop agent orchestration frameworks for multi-step reasoning, tool usage, and decisioning workflows
- Build systems for agent memory, context management, and state persistence across interactions
- Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
- Implement evaluation frameworks to measure agent performance, accuracy, and reliability




- Enable continuous improvement loops for AI agents in production
- Design and manage event-driven, asynchronous workflows for complex agent tasks
- Optimize systems for high throughput, low latency, and cost-effective inference at scale
- Build and maintain robust APIs and service layers for agent capabilities
- Partner closely with Applied AI / ML teams to productionize models and agent behaviours
- Collaborate with Product and Solutions teams to translate customer workflows into agentic systems
- Drive best practices in observability, monitoring, safety, and guardrails for AI systems
- Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms

Nice To Have

- Experience working with LLMs, conversational AI, or AI-powered products in production
- Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
- Experience building or integrating RAG pipelines, vector databases, or retrieval systems
- Exposure to evaluation systems for AI, including offline or online evals and A/B testing
- Understanding of prompting strategies, context windows, and model behavior optimization
- Experience with real-time decisioning systems or workflow orchestration engines
- Competitive compensation with performance-based upside
- Flexible vacation policy
- Health insurance coverage
- Opportunity to build cutting-edge AI products at scale
- Work with a globally distributed,



high-impact team
- Regular team offsites and in-person collaboration

More Skills Backend engineering, Platform engineering, Real-time processing, Streaming architectures, Event-driven architectures, Kubernetes, AWS, GCP, Azure, Concurrency, Performance optimization, Small Language Models, SLMs, AI Agents, Multi-step reasoning, Tool usage, Decisioning workflows, Agent memory, Context management, State persistence, Inference pipelines, External tools/services, Evaluation frameworks, Continuous improvement loops, APIs, Service layers, Observability, Monitoring, Safety, Guardrails, Multi-tenant AI platforms, Conversational AI, Agent frameworks, Tool calling, A/B testing, Prompting strategies, Context windows, Model behavior optimization, Workflow orchestration engines

Prepare for this role

Recommended resources to build the skills for this position. Sponsored.

Top 50 RAG Interview Questions

Zenaique

Curated RAG interview questions and answers from Zenaique.

Top 20 Vector Databases Questions (Quick)

Zenaique A focused vector-database interview question set from Zenaique.

Top 50 Vector Databases Interview Questions

Zenaique

Curated vector database questions covering Pinecone, Weaviate, Qdrant, and more.

More LLM jobs

AI/LLM Safety Engineer

Propio Language Services

Leawood

Today

AI/ML Engineer 2

Day And Zimmermann

United States

Today

Software/AI developer

Rackner

United States

Today

Conversational AI Engineer

Bright Vision Technologies

United States

Today

Sr Lead Software Engineer - Agentic AI Solutions

JPMorgan Chase

Mumbai

Today

Senior Technical Consultant — AI Engineering & Agentic Salesforce Delivery

Salesforce

Bengaluru

Today

📌 Senior Backend Engineer- AI Agents (Bangalore Metropolitan Area)
🏢 Top Gen AI Jobs
📍 Bangalore Metropolitan Area