About Albertsons Companies Inc.:

As a leading food and drug retailer in the United States, Albertsons Companies, Inc. operates over 2,200 stores across 35 states and the District of Columbia. Our well-known banners across the United States, including Albertsons, Safeway, Vons, Jewel-Osco and others, serve more than 36 million U.S customers each week.

We build and shape technology solutions that solve customers’ problems every day, making things easier for them when they shop with us online or in a store. We have made bold, strategic moves to migrate and modernize our core foundational capabilities, positioning ourselves as the first fully cloud-based grocery tech company in the industry.

Our success is built on a one-team approach, driven by the desire to understand and enhance the customer experience. By constantly pushing the boundaries of retail, we are transforming shopping into an experience that is easy, efficient, fun and engaging.

About Albertsons Companies India:

At Albertsons Companies India, we're not just pushing the boundaries of technology and retail innovation, we're cultivating a space where ideas flourish and careers thrive. Our workplace in India is a vital extension of the Albertsons Companies Inc. workforce and key to the next phase in the company’s technology journey to support millions of customers’ lives every day.

At the Albertsons Companies India, we are raising the bar to grow across Technology & Engineering, AI, Digital and other company functions, and transform a 165-year-old American retailer.

At Albertsons Companies

India associates collaborate directly with international teams, enhancing decision-making processes and organizational agility through exciting and pivotal projects. Your work will make history and help millions of lives each day come together around the joys of food and inspire their well-being.

Role: AI / Senior LLM Platform Engineer

Experience: 5- 8+ Years

Job Summary:





We are looking for a Senior AI / LLM Platform Engineer to design and build scalable enterprise solutions, multi-model orchestration, intelligent model routing, and cost-efficient AI capabilities. The engineer will focus on optimizing LLM selection, performance, token consumption, security, and reliability across enterprise agentic applications.

Key Responsibilities:

- Design and implement context-aware Multi-LLM Orchestration and intelligent model routing.
- Integrate multiple enterprise-approved LLMs through centralized AI gateways.
- Optimize token consumption, context windows, prompt caching, and LLM execution costs.
- Develop model-selection strategies based on task complexity, quality, latency, availability, and cost.
- Implement LLM observability, evaluation, performance monitoring, and usage analytics.
- Build reliable LLM integrations with fallback, retry, rate limiting, and structured-output validation.
- Establish enterprise AI governance, security guardrails, and reusable LLM integration standards.
- Collaborate with AI engineering teams to integrate the LLM platform with multi-agent systems.

Required Technical Skills & Tools:

- Programming: Python, FastAPI, REST APIs, Async Programming
- LLM Platforms: Azure OpenAI, Claude, Gemini, OpenAI or equivalent enterprise models
- LLM Gateways: Portkey AI Gateway, LiteLLM or equivalent
- AI Frameworks: LangChain, LangGraph, LLM APIs
- Model Orchestration: Multi-LLM Routing, Model Selection, Fallback Strategies
- Token & Cost Optimization: Tokenization, Context Engineering, Prompt Caching, LLM Cost Management
- RAG: Embeddings, Vector Search, PostgreSQL/pgvector
- Observability: LangSmith, OpenTelemetry, Prometheus, LLM Evaluation Frameworks
- Cloud & Infrastructure: Microsoft Azure, AKS, Docker, Kubernetes
- Distributed Systems: Apache Kafka (preferred), Temporal (highly preferred)

Preferred Qualifications:

- Hands-on experience with multi-model routing and cost optimization.
- Knowledge of LLM security, prompt-injection prevention, and data governance.
- Experience establishing shared AI platform capabilities across multiple applications.

📌 Senior Engineer ML-30279] (Bengaluru)
🏢 Albertsons Companies India
📍 Bengaluru