Postman Test Coverage and Quality Audit
Check that tests cover the API behaviour that matters.
The Open buttons send the prompt text as currently shown below to that site only when you click. Fill in the placeholders first.
Audit tests in a collection. List of endpoints and the tests present for each (status, schema, values, errors, auth, performance): [TEST_MATRIX]. Recent production incidents related to the API: [INCIDENTS]. Build a coverage matrix and compute coverage as the share of endpoints with each test type, with arithmetic. Judge quality: for each existing test type, name an example that would still pass if the API were broken, indicating a weak assertion; also look for tests that depend on order, use production data, or use hard-coded IDs. Map incidents to missing tests, and list the ten tests to write first, ranked by the damage a failure would cause and the incidents I described, each with a one-line description and expected result. Prefer a few meaningful tests to many weak ones. Prove a test works by changing the expected value and confirming it fails. Return a table, a plan, a coverage target and review date. Example (invented, 20 endpoints): status test 20 of 20 (100 percent), schema test 9 (45 percent), error cases 6 (30 percent).
Fill in before use
Optional: type your details and the prompt above updates. Nothing is saved or sent.
Replace each bracketed placeholder with your own details, then paste into Any AI or another assistant.
See an example result (fictional data)
Invented matrix of 20 endpoints. Status test: 20 of 20 (100 percent). Schema test: 9 (45 percent). Error cases: 6 (30 percent). Authorisation test: 4 (20 percent). Performance threshold: 2 (10 percent). Quality check: 5 status tests would still pass if the body were empty; 3 tests depend on a record that may not exist. Incidents last quarter: 2, both a missing field in a response, which a schema test would have caught. First ten tests to write: schema for orders, customers; authorisation for three endpoints; error cases for create order.
Illustrative only, made-up data. Your results will differ and must be reviewed.