Prompt Change Impact Audit: Before and After Comparison

Compare two prompt versions on the same inputs.

Added October 15, 2026. Written with AI assistance and checked for clarity and placeholders; not reviewed by a lawyer, accountant, clinician or other professional. How these prompts are made

The Open buttons send the prompt text as currently shown below to that site only when you click. Fill in the placeholders first.

Compare two versions of a prompt. Version A: [PROMPT_A]. Version B: [PROMPT_B]. A set of test inputs with outputs from each version: [OUTPUTS_BY_VERSION]. Criteria that matter (accuracy, tone, safety, format): [CRITERIA].

Score each output on each criterion from 1 to 5 and total by version with the arithmetic. Make a table with Input, Criterion, A score, B score, and Note. Identify regressions (cases where B is worse), improvements, and cases with no difference. Check the sample size and say how confident I can be. Explain which change in wording likely caused each difference, as a hypothesis. Recommend ship, revise or revert, with conditions, and write the log entry for the change.

Be explicit that a small sample cannot prove an improvement.

Add a worked comparison: 20 inputs, A passes 15 (75 percent), B passes 17 (85 percent), but 3 inputs passing in A fail in B; show the regression list and the conclusion that the evidence is suggestive only with such a small sample. Add the change-log entry.

Fill in before use

Optional: type your details and the prompt above updates. Nothing is saved or sent.

Replace each bracketed placeholder with your own details, then paste into Any AI or another assistant.