About CAI Stack

CAI Stack delivers modular AI infrastructure designed for enterprises to efficiently build, scale, and deploy ML and DL applications. Our platform empowers organizations to launch industry-specific AI products using our robust, scalable technology, trusted by global leaders for mission-critical deployments.

Role Overview

We are looking for a hands-on LLM Engineer passionate about building intelligent, high-performance applications. You will design, implement, and maintain agentic and RAG-based solutions, ensuring speed, accuracy, and scalability. Your work will directly impact how CAI Stack leverages large language models for creative business solutions.

Key Responsibilities

Develop end-to-end RAG applications, from data ingestion to real-time delivery.

Optimize retrieval pipelines to handle millions of rows with minimal latency.

Design and implement intelligent agents capable of complex decision-making using LLMs.

Enhance product data by extracting descriptive tags from images.

Prepare and clean catalog data for integration with LLM applications.





Collect and process product and review data from social platforms.

Set up hyperparameter optimization (HPO) workflows for machine learning pipelines.

Fine-tune and adapt models to improve performance on domain-specific tasks.

Collaborate with data scientists and engineers to deploy LLM applications into production.

Implement MLOps best practices for continuous integration, deployment, and monitoring.

Stay updated on advancements in LLM architectures, agentic frameworks, and RAG methodologies.

Required Qualifications

Proven experience building and deploying agentic and RAG-based applications in production.

Ability to optimize retrieval pipelines for large datasets (3M+ rows).

Experience with tool-based setups like TrinoDB, web browsers, and Python/Scala REPLs.

Hands-on experience building LLM agents across platforms such as Gemini, OpenAI, and Claude.

Experience with multimodal tasks s

📌 Senior Backend Engineer (Bengaluru)
🏢 CAI Stack
📍 Bengaluru