18 Nov
|
National Institute for Smart Government (NISG)
|
New Delhi
18 Nov
National Institute for Smart Government (NISG)
New Delhi
Role & responsibilities a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
- Lead end-to-end model evaluation, benchmarking, and validation activities for foundation models and AI/ML solutions, ensuring alignment with project objectives and quality standards.
- Define, monitor, and analyze key model performance metrics, including accuracy, precision, recall, F1 score, BLEU/ROUGE, latency, throughput, hallucination rate, robustness, bias, safety, multilingual performance, and inference cost.
- Oversee the AI/ML model lifecycle across training, fine-tuning, evaluation, deployment, monitoring, and continuous improvement initiatives.
- Drive MLOps practices, including model versioning, experiment tracking, CI/CD pipelines, deployment automation, monitoring, retraining strategies, and governance compliance.
- Monitor and optimize compute resource utilization across GPU, TPU, HPC, cloud, and distributed environments to ensure operational efficiency and cost optimization.
- Collaborate with internal teams, startups, research partners, cloud providers,
and evaluation agencies to execute model assessments, benchmarking studies, and technical reviews.
- Develop and maintain technical dashboards, MIS reports, performance scorecards, and executive-level progress updates for stakeholders.
- Establish deployment readiness criteria, model governance frameworks, and risk management practices for AI systems.
- Identify and resolve performance bottlenecks, scalability challenges, infrastructure gaps, and operational risks impacting model effectiveness.
- Support the development and implementation of evaluation frameworks, testing methodologies, and best practices for responsible AI, model safety, fairness, and compliance.
- Provide technical guidance and recommendations to leadership on model selection, deployment strategies, infrastructure planning, and optimization opportunities.
- Stay updated with advancements in Generative AI, Foundation Models, LLMOps, MLOps, model evaluation frameworks, and AI infrastructure technologies.
📌 MLOps (New Delhi)
🏢 National Institute for Smart Government (NISG)
📍 New Delhi