Job Summary

We are seeking an experienced AI/ML Architect to lead the design and development of scalable, real-time AI systems. You will work closely with product, data, and engineering teams to architect end-to-end solutions — from model development and deployment to system integration and production monitoring.

Key Responsibilities

- Design and architect AI/ML systems that are scalable, low-latency, and production-ready
- Lead development of real-time inference pipelines for use cases like voice, vision, or NLP
- Select and integrate appropriate tools, frameworks, and infrastructure (e.g., Kubernetes, Kafka, TensorFlow, PyTorch, ONNX, Triton, VLLM etc.)
- Collaborate with data scientists and ML engineers to productionize models
- Ensure reliability, observability, and performance of deployed systems
- Conduct architecture reviews, POCs, and system optimizations
- Mentor engineers and help set best practices for ML lifecycle (MLOps)

Requirements

- 6+ years of experience building and deploying ML systems in production
- Proven expertise in real-time, low-latency system design (e.g., streaming inference, event-driven pipelines)




- Strong understanding of scalable architectures — microservices, message queues, distributed training/inference
- Proficient in Python and popular ML/DL frameworks (scikit-learn, TensorFlow, PyTorch)
- Hands-on experience with LLM inference optimization using frameworks like vLLM, TensorRT-LLM, and SGLang
- Familiarity with vector databases, embedding-based retrieval, and RAG pipelines
- Experience with containerized environments (Docker, Kubernetes) and managing multi-container applications
- Working knowledge of cloud platforms (AWS, GCP, or Azure) and CI/CD practices for ML workflows
- Exposure to edge deployments and model compression/optimization techniques
- Solid foundation in software engineering principles and system design

Nice to Haves

- Experience in Linux (Ubuntu)
- Terminal/Bash Scripting

Date Opened 08/06/2026

Job Type

Full time

Years of Experience

10 - 12 Years

Domain

Business Management

City

Chennai

State/Province

Tamil Nadu

Country

India

Zip/Postal Code

600001

📌 AI/ML Architect (Chennai)
🏢 Recode Solutions
📍 Chennai