Usability Benchmark Study Design
Measure usability over time.
The Open buttons send the prompt text as currently shown below to that site only when you click. Fill in the placeholders first.
Design a usability benchmark. Product and flows: [PRODUCT_AND_FLOWS]. Existing metrics: [EXISTING_METRICS]. Participants available per round: [PARTICIPANTS_PER_ROUND]. Define a repeatable method: a fixed set of 5 to 8 tasks; metrics per task (success rate with confidence interval, time on task using geometric mean or median, errors, and a single ease question rated 1 to 7); an overall questionnaire (SUS, with the scoring rule: for odd items subtract 1, for even items subtract the value from 5, sum and multiply by 2.5; give a worked example); sample size guidance (about 20 or more per round for stable summaries, noting wide intervals with fewer); and a schedule (every six months). Add comparison rules (same tasks, same participant criteria, same moderator script), reporting format with trend table, and cautions on small samples and changing populations. Include statistical caution: differences within the interval are not evidence of change. Give a worked example of computing the SUS score for one participant from ten answers with the arithmetic, and a template for reporting each round with task success, time, SUS, and a comparison with the previous round.
Fill in before use
Optional: type your details and the prompt above updates. Nothing is saved or sent.
Replace each bracketed placeholder with your own details, then paste into Any AI or another assistant.