AI Compare · Test kit
Summarize a report with traceable facts
A one-page quarterly report with ten decision facts, a figure that excludes a new store, and a price rise that has not been decided. A good summary keeps every fact, says where it came from, and adds nothing.
Prices for United States, before sales tax Data release 2026.10.16-3, Oct 16, 2026 Rules 2.1.0
Run the test
- Download the file for the AI.
- Copy the prompt.
Summarize the attached report for a busy manager in at most 200 words. Include every number that affects a decision, name the section each one comes from, and do not add anything that is not in the report.
- Open the AI in another tab, in your own account, start a fresh chat, attach the file and paste the prompt.
- Note what you used: the plan, the visible model or mode, whether web search was on, how many attempts it took and anything that went wrong.
- Score the answer with the checks below. Run the same kit in each AI you are choosing between, or paste their answers into the blind review.
Scorecard
Critical checks are marked. One failed critical check matters more than a nice style.
- States revenue of $4.82 million and the 11% riseCritical
- Gives 3,940 units and says Tacoma is not included in that figureCritical
- Gives Q4 guidance as the range $5.1M to $5.4MCritical
- Mentions the $86,000 inventory write-downCritical
- Does NOT present the price increase as decidedCritical
- Contains no number or fact that is not in the reportCritical
- Gives the 2.7% return rate
- Names the section for each number
- Stays within 200 words
Compare answers blind
Paste the answer each AI gave, score them without seeing which AI wrote which, then reveal. You ran the tests yourself, so you may still recognise a style: hiding the names reduces that bias, it does not remove it. The answers stay in this tab and are never saved or sent anywhere; only the scores are kept, on this device, when you reveal.
Reference answer (open after you score)
Ten decision facts: revenue $4.82M (+11%); 3,940 units excluding Tacoma (Tacoma 212 separately); e-bikes 38% of revenue; return rate 2.7%; Tacoma opened August 4; brake supplier moved to Brennan ($41,000 tooling); $86,000 write-down, no cash effect; warehouse 39 to 46 people; Q4 guidance $5.1M to $5.4M including Tacoma; price rise up to 4% under review, NOT decided. 'About a fifth of complaints' is not a precise figure and should not be turned into one.
Kit version 1.0.0, files frozen on Oct 12, 2026. Original fixture by What the tech, released under CC BY 4.0. Fictional people, companies and figures. A passing score shows how one answer did on this kit; it does not prove the tool is generally better.