Primary Goal

To design a robust, high-availability system that handles 100+ concurrent VLM requests with low latency. This person is the "bridge" between the model and the production environment.

Key Responsibilities

- System Blueprint: Design the end-to-end architecture, including load balancing, asynchronous task queues (Celery/RabbitMQ), and GPU memory management.
- Inference Orchestration: Implement high-throughput serving engines like vLLM, Triton, or TensorRT-LLM to handle parallel request batching.
- Data Flow & Storage: Architect the pipeline for multi-modal data (images/videos) ensuring fast retrieval and optimized storage (S3/Vector DBs).
- Cost & Performance: Monitor GPU utilization and implement autoscaling to ensure you aren't paying for idle "H100/A100" time.

Must-Have Skillset

- System Design: Deep knowledge of Microservices, API Gateways, and Caching strategies (Redis).
- Compute: Expert in Kubernetes (K8s), Docker, and NVIDIA Container Toolkit.
- Backend: Advanced Python/FastAPI or Go for high-concurrency systems.
- Tools: Terraform (IaC), Prometheus/Grafana for observability.

Join Our Team

At Mantra, we understand each employee has a unique role and responsibility.



Come explore the recent opportunities across different locations.

At Mantra Softech, we work hand in hand towards one goal to Make customers happy with the best service. Our objectives are clear and we give our team the best tools to help them achieve that goal. Whatever role they play, we motivate employees to make a difference for our customers, our team, and ourselves.

1. Application Submission

Browse our open positions and submit your CV through our online portal. Ensure your profile highlights your technical expertise and passion for innovation.

2. Profile Shortlisting

Our talent acquisition team carefully reviews every application to match your skills and aspirations with our evolving business needs.

3. Technical Evaluation

Engage in deep technical discussions with our experts and leaders to showcase your problem-solving abilities and domain knowledge.

4. Joining the Tribe

Upon successful evaluation, receive an offer and embark on your journey to secure the digital identity of millions together with us.

📌 AI System Architect (India)
🏢 Mantra Softech
📍 India