We are looking for a highly experienced AI Architect / AI Platform Architect to design, develop, and operate large-scale, distributed AI systems in production. The ideal candidate will have solid expertise in AI platform architecture, distributed systems, API design, reliability engineering, AI quality/evaluation, and AI observability.

The role will focus on building reusable AI platform capabilities and reference architectures that can be adopted by multiple teams across an enterprise, rather than developing one-off AI applications.

Experience

- 10+ years of experience designing, developing, and operating large-scale distributed AI systems in production.
- 3+ years of experience in AI Platform, Architecture, Principal Engineer, Lead Engineer, or Architect roles preferred.
- Strong experience working with enterprise-scale AI/ML or GenAI platforms.

Top 3 Must-Have Skills
1. AI Platform Architecture & Distributed Systems

- Design scalable AI platforms and reusable components.
- Strong understanding of API design, distributed systems, scalability, availability, and reliability engineering.
- Experience building platform capabilities consumed by multiple engineering teams.

1. AI Quality & Evaluation

- Experience implementing AI/ML/GenAI quality and evaluation practices.
- Ability to define evaluation frameworks, quality metrics, validation approaches, and production-quality standards for AI systems.

1. AI Telemetry & Monitoring

- Experience establishing AI observability, telemetry, monitoring,



and operational foundations.
- Robust understanding of production reliability, performance monitoring, troubleshooting, and operational readiness of AI systems.

Key Responsibilities
- Define and drive architecture for enterprise-scale AI and GenAI platforms.
- Design reusable APIs, services, frameworks, templates, and platform components.
- Establish scalable patterns for AI application development and deployment.
- Design distributed AI systems with solid reliability, security, scalability, and performance characteristics.
- Develop AI quality, evaluation, monitoring, and telemetry foundations.
- Define and implement production-readiness and operational standards for AI workloads.
- Establish reusable reference implementations and accelerators to drive AI adoption across teams.

- Design enterprise patterns for

- AI/Agent/Tool registries

- Private registries

- RAG and grounding

- Retrieval and memory

- Context management and budgeting

- Production hardening
- Partner with engineering, data science, cloud, security, and product teams to establish enterprise AI architecture standards.
- Evaluate emerging AI/GenAI technologies and determine their applicability to enterprise platforms.
- Mentor senior engineers and architects and influence technical direction across teams.

Preferred Technical Experience
- Generative AI and Large Language Models such as:

- OpenAI / GPT

- Google Gemini

- Meta Llama

📌 AI Architect (Hyderabad)
🏢 Elabs Infotech
📍 Hyderabad