Job description:

Job Description
AI Systems Architect, end-to-end design and delivery of production-grade agentic and Generative AI systems. This is a highly hands-on role requiring deep architectural insight, coding proficiency, and an obsession with performance, scalability, and reliability. Should architect, secure, cost-efficient AI platforms on AWS, guide developers through complex debugging and optimization, and ensure all systems are observable, governed, and production-ready.
͏
Architect Production AI Systems: Design robust overall architectures for agentic systems (planning, reasoning, tool-calling), GenAI/RAG pipelines, and evaluation workflows. Create detailed design documents including flow/UML/sequence diagrams and AWS deployment topologies. Additionally, ensure architectures support advanced LLM training and inference workflows, incorporating distributed strategies for scalability.
Optimize for Cost & Performance: Model throughput, latency, concurrency, autoscaling, CPU/GPU sizing, and vector index performance to ensure scalable, productive deployments.



Include optimization for multi-node GPU clusters and distributed training efficiency to reduce compute overhead.
Lead Debugging & Stability Efforts: Conduct deep-dive debugging, fix critical defects, and resolve production incidents; pair-program with developers to improve code quality and performance. Apply MLOps-driven stability practices, leveraging configuration management and automated recovery for high availability.
Standardize Agentic Frameworks: Build reference implementations using Semantic Kernel (preferred), LangGraph, AutoGen, or CrewAI with strong schema validation, grounding, and memory management.
Implement Observability & Monitoring: Set up distributed tracing, metrics, and logging via OpenTelemetry and Datadog. Standardize dashboards, alerts, and incident response workflows.
Govern Evaluation & Rollouts: Build test and evaluation frameworks—golden sets, A/B experiments, regression suite

📌 Principal Engineer (Bengaluru)
🏢 Wipro
📍 Bengaluru