Position: Manager AI/ML Evaluation & MLOps

Experience: 6+ Years

Qualification: B.E./B.Tech/M.Tech/MCA/MBA in Computer Science, IT, AI/ML, Data Science, Business Analytics, or related disciplines.

Key Responsibilities:

- Manage AI/ML model evaluation, benchmarking, performance monitoring, and deployment readiness.
- Track model metrics such as accuracy, latency, robustness, safety, bias, and inference costs.
- Monitor model lifecycle activities including training, fine-tuning, validation, deployment, and post-deployment performance.
- Oversee MLOps processes including model versioning, experiment tracking, CI/CD, APIs, monitoring, and retraining.
- Review compute utilization across cloud, GPU/TPU, HPC, and inference infrastructure.
- Prepare technical MIS reports, dashboards, benchmarking summaries, and progress updates.

Required Skills:

- Experience in AI/ML, MLOps, model evaluation, cloud platforms, data platforms, or technical program management.
- Robust understanding of model lifecycle, benchmarking, deployment, monitoring, and inference.
- Familiarity with Git, MLflow, Weights & Biases, Docker, Kubernetes, CI/CD, APIs, cloud platforms, GPUs/TPUs, and monitoring tools.

📌 Model Evaluation & MLOps - IndiaAI (New Delhi)
🏢 National Institute for Smart Government (NISG)
📍 New Delhi