Job Description

About TrueFoundry

n

n

Every production AI system, whether it‘s powering customer support, writing code, analyzing financial data, or diagnosing medical conditions, needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

n

That infrastructure layer is being built right now.

n

We are looking for a Senior Software Engineer-Core Team.

n

The Problem We‘re Solving

n

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

n

The infrastructure to support this doesn‘t exist yet. You can‘t just duct-tape together a few API calls and call it production-ready.

n

You need a control plane that handles:

n

n
- Intelligent routing with observability, cost policies, and fallback logic
n
- Centralized tool and MCP server management with security and lifecycle controls
n
- Agent orchestration with governance and guardrails
n
- A unified compute layer to run self-hosted models, custom tools, and agents
n

n

AI Gateway is the control plane: five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

n

We‘re Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

n

You will:

n

n




- Solve some of the most complex Engineering problems and drive it alongside a team of engineers & ML researchers.
n
- Build a deep, holistic understanding of the TrueFoundry platform across all components and shape the product vision and implementation.
n
- Act as the technical face of engineering for customer-related discussions and escalations
n
- Guide and unblock engineers across projects in the US region
n
- Partner closely with our CTO and India-based engineering team to drive system design, architecture, and implementation of complex products
n
- Lead technical design, critical customer problem-solving, and platform scalability initiatives end-to-end
n

n

This is a high-ownership, high-impact role designed for an engineer who loves combining world-class systems thinking with real-world execution.

n

What You’ll Do:

n

n
- Develop deep expertise across TrueFoundry’s platform stack — infrastructure, deployment systems, LLM/ML orchestration, observability, cost optimization, and more
n
- Drive the system architecture and design for complex, distributed, cloud-native systems
n
- Act as the technical point-of-contact for enterprise customer engineering needs and escalations
n
- Lead and participate in design reviews, code reviews, and critical incident responses
n
- Collaborate closely with the CTO on architectural decisions, scaling strategies, and technical roadmap prioritization
n




- Guide and mentor US-based engineers across multiple initiatives, helping them deliver high-quality, scalable systems
n
- Identify and drive technical debt cleanup, performance improvements, and resilience upgrades across the platform
n
- Bring a product engineering mindset, ensuring that customer needs and feedback translate into scalable engineering solutions
n

n

Who You Are:

n

n
- 4-8 years of strong backend/systems engineering experience at top technology companies or startups
n
- Deep expertise in distributed systems, cloud-native architectures, and scalable system design
n
- Solid working knowledge of Kubernetes, containerized workloads, and infrastructure engineering
n
- Practical experience building or deploying ML/GenAI applications (or closely working with ML/DS teams)
n
- Skilled in programming languages such as Python, Golang, TypeScript, and Node.js
n
- Solid understanding of system observability, resiliency design, and SRE practices
n
- Strong technical leadership and communication skills — able to work with both customers and engineering teams
n
- Ability to think strategically while also executing hands-on when required
n

n

Perks of Working at TrueFoundry

n

n
- Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.
n
- Comprehensive health insurance for you and your family.
n
- Flexible hybrid work, 3 days a week in the office (Tuesday, Wednesday and Thursday), with flexibility around the schedule.
n
- Lunch and snacks are on us whenever you come into the office.
n
- Work from another TrueFoundry office for up to 3 months each year, whether that‘s our London or Bay Area office, if you‘d like a change of scenery.
n

📌 Senior Software Engineer (Core Team) (Bengaluru)
🏢 TrueFoundry
📍 Bengaluru