Mandatory Skills : AI/GenAI Research, AI/ML Awareness Testing, AI/ML Testing
Required experience
Full Stack AI Assurance Engineer to design develop the
test cases with data sets for LLM Evaluation using AI Trust Assure framework and test AILLM evaluations and recommendations
The ideal candidate will have a robust foundation in AIML concepts Python programming and RAGAS any equivalent frameworks along with handson experience in prompt engineering and models classification data classification
Key Responsibilities
Identify and analyse the Data preparations for Model Evaluation specific to AIML systems including ethical legal safety security and operational risks and
Evaluate potential for bias unfairness lack of transparency and robustness etc
Evaluate and monitor data pipelines to ensure high data quality integrity and representativeness for AIML models
Develop and execute validation plans for AIML models including performance, robustness fairness and security testing
Implement tools and practices to enhance the interpretability and transparency of AI models and outcomes
Assess AI systems for ethical and fairness considerations and implement or recommend mitigation strategies as needed
Set up and manage monitoring systems for AI models in production identifying and addressing drifts anomalies or policy violations
Work closely with data scientists ML engineers compliance teams and
business stakeholders to embed assurance practices throughout the AI lifecycle
Contribute to the development and continuous improvement of AI governance frameworks and best practices
Perform code reviews debugging and continuous improvement of automation pipelines
Stay updated on emerging trends in AI ML and DL for AI Assurance
Required Skills
Bachelors or Masters degree in Computer Science Data Science Engineering
or a related field
Minimum 5 years of experience in AIML data science software quality assurance or a related domain
Hands on Exp in vibe coding such as Copil
📌 AI Assurance Engineer (Hyderabad)
🏢 LTM
📍 Hyderabad