AI Compare · Test kit
Research a current question within a date window
An open-web question with an answer that changes every month: the latest US inflation figure from its official source. You check the answer yourself on the official site, on the same day, and record when and how you ran it.
Prices for United States, before sales tax Data release 2026.10.16-3, Oct 16, 2026 Rules 2.1.0
Run the test
This kit uses the open web. Its right answer changes over time, so run it in every AI on the same day, with web search on, and check the answer yourself on the official source. A run on another day is a different test.
- Download the protocol sheet for yourself.
- Copy the prompt.
Today is [TODAY]. Search the web and answer: What is the most recent 12-month change in the US Consumer Price Index for All Urban Consumers (CPI-U), all items, not seasonally adjusted, as published by the US Bureau of Labor Statistics (BLS)? Give the percentage, the month the figure covers, and the date BLS published it. Use only sources published in the 45 days before today. Link to the BLS release itself, and list every other source you used with its publication date.
- Open the AI in another tab, in your own account, start a fresh chat and paste the prompt. Turn web search on.
- Note what you used: the plan, the visible model or mode, whether web search was on, how many attempts it took and anything that went wrong.
- Score the answer with the checks below. Run the same kit in each AI you are choosing between, or paste their answers into the blind review.
Scorecard
Critical checks are marked. One failed critical check matters more than a nice style.
- Links the BLS release itself (bls.gov), not only a news storyCritical
- The percentage matches the latest BLS release on the day you ran itCritical
- Names the month the figure covers correctlyCritical
- Uses no source older than 45 days, or says plainly when it didCritical
- Gives the BLS publication date correctly
- Lists its other sources with their dates
- Says how current the figure is
Compare answers blind
Paste the answer each AI gave, score them without seeing which AI wrote which, then reveal. You ran the tests yourself, so you may still recognise a style: hiding the names reduces that bias, it does not remove it. The answers stay in this tab and are never saved or sent anywhere; only the scores are kept, on this device, when you reveal.
Reference answer (open after you score)
There is no fixed answer: it changes every month. Open https://www.bls.gov/cpi/ on the day you run the test; the latest Consumer Price Index news release gives the 12-month change for all items before seasonal adjustment, the month it covers and its release date. Results from different days, or from before and after a new release, are not comparable. A correct figure taken only from a news story fails the primary-source check.
Kit version 1.0.0, files frozen on Oct 13, 2026. Original fixture by What the tech, released under CC BY 4.0. Fictional people, companies and figures. A passing score shows how one answer did on this kit; it does not prove the tool is generally better.