ABOUT THIS ROLE
You will own the complete architecture for private and sovereign AI deployment at Trianz. This is not a cloud-API-consumption role. You will design the system that runs large language models inside customer environments -- choosing the right models, designing the serving topology, setting CPU and GPU routing policies, and ensuring the entire stack is secure, sovereign, and provider-agnostic. This is a pure IC role with architectural authority over how AI runs in production.

WHAT YOU WILL DO
• Design the complete private LLM serving architecture: model selection, serving framework (vLLM,TensorRT-LLM, Triton), and runtime topology.
• Define intelligent CPU vs GPU routing policies: which model sizes and prompt types route to which compute tier based on latency, cost, and throughput targets.
• Architect multi-cloud model serving: AWS, Azure, GCP -- provider-agnostic, no managed AI lock-in.
• Design on-premises serving for enterprise customers: RedHat OpenShift, VMware -- containerised model serving on customer hardware.
• Architect per-tenant model isolation,



data-residency compliance, and air-gapped sovereign deployment patterns.
• Define the release architecture for model versions: rollout, staged deployment, rollback, and promotion gates.
• Design the LLM governance framework: model behaviour monitoring, inference audit logging, guardrail architecture.
• Design the DevSecOps pipeline architecture and self-service deployment automation standards.
• Evaluate open-source models (Llama, Mistral, Qwen, Phi) against closed models for specific enterprise use cases.
• Produce architecture sign-off documents and review all AI system designs before implementation.

MUST HAVE
• Deployed LLMs to production in a real enterprise setting -- not just API consumption.
• Hands-on with vLLM, TensorRT-LLM, or Triton in a production serving context
• Designed CPU cluster inference (Intel Xeon / AMD EPYC) for open-source models.
• Kubernetes at production scale (EKS,

📌 Principal AI Architect (Bengaluru)
🏢 Trianz
📍 Bengaluru