Deloitte s Technology & Transformation practice can help you uncover and unlock the value buried deep inside vast amounts of data. Our global network provides strategic guidance and implementation services to help companies manage data from disparate sources and convert it into accurate, actionable information that can support fact-driven decision-making and generate an insight-driven advantage. Our practice addresses the continuum of opportunities in business intelligence & visualization, data management, performance management and next-generation analytics and technologies, including big data, cloud, cognitive and machine learning.
Your work profile
As an Analyst in AI-driven Quality Engineering, you will play a critical role in validating the reliability, accuracy, and ethical behavior of Large Language Model (LLM)-based applications. You will work at the intersection of AI, testing,
and business workflows to ensure that AI systems are trustworthy, performant, and production-ready.
Key Responsibilities
1. LLM Functional Testing
- Design and execute test scenarios for LLM-based applications (chatbots, copilots, generative AI systems)
- Validate response correctness, relevance, and contextual understanding
- Perform prompt-based testing to assess model behaviour under wide-ranging inputs
2. Prompt Engineering & Validation
- Create, refine, and optimize prompts to test different use cases and edge conditions
- Identify prompt vulnerabilities such as hallucinations, bias, and unsafe outputs
- Evaluate consistency and determinism across multiple runs
3. AI Quality Dimensions Validation
- Validate outputs across key AI quality pillars:
- Accuracy & relevance
- Coherence & fluency
- Bias & fairness
- Safety & compliance
- Perform adversarial testing to uncover unexpected or harmful responses