01
LLM Evaluation
Correctness, relevance, completeness, consistency and safety.
AI QA GUIDE
AI systems need more than prompt checks. Quality has to cover the model, knowledge, agent behaviour, security, user experience, accessibility, automation and production lifecycle.
01
Correctness, relevance, completeness, consistency and safety.
02
Retrieval quality, evidence, hallucination, missing and stale knowledge.
03
Tools, arguments, orchestration, memory, recovery and handovers.
04
Prompt injection, data leakage, authorisation and unsafe actions.
05
Multi-turn context, intent, clarification, escalation and customer outcomes.
06
Web, mobile and conversational AI accessibility.
07
API, UI, Playwright and AI evaluation automation.
08
Versioned critical journeys and release evidence.
09
Quality signals, failure discovery and continuous improvement.
APPLY THIS TO YOUR PRODUCT
Use the guide to understand the layers, then work directly with Suresh to assess or engineer them.