AI Trust Assurance Engineer
Experience: 5–16 Years
Work Mode: Hybrid
Locations: Pune, Mumbai, Chennai, Hyderabad, Bangalore, Noida & Kolkata
Notice Period: Immediate Joiners to 30 Days Only
About the Role
We are seeking an experienced AI Trust Assurance Engineer to ensure the quality, reliability, safety, security, and trustworthiness of AI/ML and Generative AI solutions. The ideal candidate will have strong expertise in AI Testing and Python , with hands-on experience testing AI/ML models, LLM-based applications, APIs, data pipelines, and AI-powered systems.
Key Responsibilities
- Design and execute testing strategies for AI/ML and Generative AI applications.
- Perform functional, integration, regression, end-to-end, performance, and reliability testing.
- Build Python-based automation frameworks and reusable testing utilities.
- Validate LLMs, RAG pipelines, AI Agents, embeddings, vector search, and prompt-response workflows.
- Assess AI outputs for accuracy, consistency, hallucinations, bias, fairness, toxicity, robustness, and relevance.
- Perform API testing and data validation using SQL.
- Validate AI model inputs, outputs, and data pipelines.
- Identify AI security, privacy, governance, and Responsible AI risks.
- Collaborate with Data Scientists, ML Engineers, Developers, and Product teams.
- Prepare test plans, defect reports, quality metrics, and documentation.
Required Skills
- AI Testing
- Python
- Software Testing / QA
- AI/ML Testing
- Generative AI / LLM Testing
- Test Automation
- API Testing
- SQL
- Functional & Integration Testing
- Defect Management
Preferred Skills
- RAG
- AI Agents
- LangChain
- LangGraph
- Prompt Engineering
- Prompt Testing
- Responsible AI
- AI Governance
- AI Security Testing
- Model Validation
- Bias & Fairness Testing
- Hallucination Testing
- AWS / Azure / GCP
- PyTest
- Playwright
- Selenium
- Robot Framework
- CI/CD
- JMeter
Experience
- 5–16 years of Software Testing, Automation Testing, AI/ML Testing, or AI Quality Engineering.
- Solid hands-on experience in AI Testing and Python is mandatory.
- Experience testing AI/ML models or GenAI/LLM applications is highly preferred.
Notice Period: Immediate to 30 Days only.
📌 AI Trust Assurance Engineer (India)
🏢 Harp
📍 India