15 Oct
|
Data Security Council of India
|
Noida
15 Oct
Data Security Council of India
Noida
Role Summary
The AI Safety Research & Testing Skilled will play a key technical role in advancing AI safety research and evaluation capabilities. The role involves designing and conducting structured, code-based evaluations of publicly accessible AI models and AI-enabled products, and developing Python-based evaluation pipelines to support these activities.
The Professional will conduct hands-on technical testing, adversarial evaluation, failure analysis, and comparative benchmarking, while monitoring emerging AI safety and security research. The role will translate empirical findings, published frameworks, and established standards into practical guidance, readiness assessments, and recommendations for industry members and partners.
This is a hands-on, technically focused research and testing role covering model APIs, open-source evaluation frameworks, evaluation datasets, automated testing, RAG, tool use, agents, and other AI-enabled application components.
Key Responsibilities
Research & Landscape Analysis
• Conduct structured literature reviews of AI safety and security research,
including reports from AI safety institutes, evaluation labs, and research organisations.
• Track frontier and open-weight model releases and assess their safety and security implications.
• Monitor emerging research on evaluation, red-teaming, robustness, interpretability, alignment, AI security, RAG, and agentic systems.
• Assess relevant evaluation frameworks, benchmarks, attack methodologies, and testing tools.
• Contribute to the Global & Regional AI Safety Landscape briefing and internal knowledge base.
Technical Testing & Evaluation
• Design and implement evaluation pipelines using open-source frameworks and custom Python tooling to test publicly accessible models and AI-enabled products.
• Build and maintain test scripts, model/API integrations, structured test cases, scoring rubrics, automated grading, and reporting pipelines.
• Test key risk areas including prompt inject
📌 AI Safety Research (Noida)
🏢 Data Security Council of India
📍 Noida