Primary Goal

Manage the "GPU Fleet." This role ensures that the website operations are stable and that the infrastructure scales up when traffic hits and scales down to save money.

Key Responsibilities

- GPU Orchestration: Manage multi-GPU clusters using Kubernetes (K8s) and KubeRay or NVIDIA's GPU Operator.
- Autoscaling: Design custom metrics (e.g., "GPU Queue Depth") to trigger the spinning up of new cloud instances (AWS P4/P5, GCP A3, etc.).
- Observability: Set up Prometheus/Grafana dashboards to monitor VRAM usage, power consumption, and hardware health.
- Model Versioning: Implement a registry (MLflow or Weights & Biases) to roll back models instantly if a new version fails in production.

Must-Have Skillset

- Infrastructure: Kubernetes, Terraform (IaC), Docker.
- Cloud: AWS (Sagemaker/EKS), GCP (Vertex/GKE), or Azure AI.
- Monitoring: Grafana, Prometheus, ELK Stack.
- Networking: Knowledge of RDMA/InfiniBand for distributed multi-node inference.

Join Our Team

At Mantra, we understand each employee has a unique role and responsibility. Come explore the new opportunities across different locations.





At Mantra Softech, we work hand in hand towards one goal to Make customers happy with the best service. Our objectives are explicit and we give our team the best tools to help them achieve that goal. Whatever role they play, we motivate employees to make a difference for our customers, our team, and ourselves.

1. Application Submission

Browse our open positions and submit your CV through our online portal. Ensure your profile highlights your technical expertise and passion for innovation.

2. Profile Shortlisting

Our talent acquisition team carefully reviews every application to match your skills and aspirations with our evolving business needs.

3. Technical Evaluation

Engage in deep technical discussions with our experts and leaders to showcase your problem-solving abilities and domain knowledge.

4. Joining the Tribe

Upon successful evaluation, receive an offer and embark on your journey to secure the digital identity of millions together with us.

📌 Senior MLOps Engineer (India)
🏢 Mantra Softech
📍 India