Evaluation & Testing AI Agents & Automation
Prompts
-
Regression Check Before Changing a Prompt
Compare old and new prompt outputs on the same inputs.
-
Hallucination Check for Summaries
Compare a model summary with its source and flag unsupported statements.
-
Prompt Injection Test Cases for My Assistant
Write defensive test inputs to see whether an assistant ignores hidden instructions.
-
Human Review Sampling Plan for Automated Output
Decide how many automated results a person should check and how often.
-
Failure Log and Root Cause Template for AI Workflows
Record each failure so patterns point to the real fix.
-
Compare Two Models on My Own Tasks
Run a fair side-by-side test using your real work, not benchmarks.
-
Acceptance Criteria for an Automation Project
Write measurable pass conditions before building starts.
-
Monitoring Dashboard Spec for a Live AI Feature
List the signals to watch once users depend on the feature.
-
Agent Test Case Suite Designer
Build a set of test cases that cover normal use, edge cases and failures.
-
Defensive Red-Team Checklist for a Customer Support Agent
Test your own agent for prompt injection and data leakage, safely.
-
Evaluation Rubric for Agent Answers
Write a rubric that scores helpfulness, accuracy, safety and honesty.
-
Golden Examples Set: Collecting and Maintaining Reference Answers
Build a small set of reference interactions and keep it current.
-
Regression Log for Prompt Changes
Track every prompt change and its effect on test results.
-
Agent Pilot Plan: Safe Rollout to a Small Group
Plan an AI agent pilot for a small group, with success measures, safeguards and a clear stop rule before wider rollout.
No prompts match those filters.