AI Compare · Test kit
Make a short clip that follows a brief
A five-second shot with one camera move and one small event: a yellow leaf falls into a bicycle basket. Checks that the clip follows the brief and that the bicycle stays the same bicycle from the first frame to the last.
Prices for United States, before sales tax Data release 2026.10.16-3, Oct 16, 2026 Rules 2.1.0
Run the test
- Download the file for the AI.
- Copy the prompt.
Paste the brief from the file (the part between the lines) into the AI exactly as written, and score the first clip it gives you.
- Open the AI in another tab, in your own account, start a fresh chat, attach the file and paste the prompt.
- Note what you used: the plan, the visible model or mode, whether web search was on, how many attempts it took and anything that went wrong.
- Score the answer with the checks below. Run the same kit in each AI you are choosing between.
Scorecard
Critical checks are marked. One failed critical check matters more than a nice style.
- A red bicycle with a brown basket against a white wall, in daylightCritical
- The bicycle stays the same from the first frame to the last: colour, basket, two wheelsCritical
- The camera starts close on the basket and moves back and to the right until the whole bicycle showsCritical
- One yellow leaf falls into the basket about halfway and stays thereCritical
- Between 4 and 8 seconds long
- Nothing else moves
- No people, text, captions or logo (a watermark the service adds is recorded separately)
To compare without knowing which AI made which, ask someone else to save the clips as A, B and C before you score them, and to tell you which is which afterwards.
Reference answer (open after you score)
There is no reference clip: score against the brief, watching at least twice. The usual failures are a bicycle that changes shape or colour, a basket that appears or vanishes, a leaf that falls past the basket or lands and disappears, extra motion such as a moving background, and a camera that moves the wrong way. Record the length, resolution, generation time and attempts in the run log.
Kit version 1.0.0, files frozen on Oct 13, 2026. Original fixture by What the tech, released under CC BY 4.0. Fictional people, companies and figures. A passing score shows how one answer did on this kit; it does not prove the tool is generally better.