06 Sep
|
Data Security Council of India
|
Noida
06 Sep
Data Security Council of India
Noida
Role Summary
The AI Safety Research & Testing Qualified will play a key technical role in advancing AI safety research and evaluation capabilities. The role involves designing and conducting structured, code-based evaluations of publicly accessible AI models and AI-enabled products, and developing Python-based evaluation pipelines to support these activities.
The Professional will conduct hands-on technical testing, adversarial evaluation, failure analysis, and comparative benchmarking, while monitoring emerging AI safety and security research. The role will translate empirical findings, published frameworks, and established standards into practical guidance, readiness assessments, and recommendations for industry members and partners.
This is a hands-on, technically focused research and testing role covering model APIs, open-source evaluation frameworks, evaluation datasets, automated testing, RAG, tool use, agents, and other AI-enabled application components.
Key Responsibilities
Research & Landscape Analysis
Conduct structured literature reviews of AI safety and security research,
including reports from AI safety institutes, evaluation labs, and research organisations.
Track frontier and open-weight model releases and assess their safety and security implications.
Monitor emerging research on evaluation, red-teaming, robustness, interpretability, alignment, AI security, RAG, and agentic systems.
Assess relevant evaluation frameworks, benchmarks, attack methodologies, and testing tools.
Contribute to the Global & Regional AI Safety Landscape briefing and internal knowledge base.
Technical Testing & Evaluation
Design and implement evaluation pipelines using open-source frameworks and custom Python tooling to test publicly accessible models and AI-enabled products.
Build and maintain test scripts, model/API integrations, structured test cases, scoring rubrics, automated grading, and reporting pipelines.
Test key risk areas including prompt injection, indirect inj
📌 AI Safety Research (Noida)
🏢 Data Security Council of India
📍 Noida