EXP-001AI Travel Planner
Three coding agents, one 1,245-line product spec, eight hours each. Build a real AI travel SaaS and deploy it.
- CCClaude Code
- CXOpenAI Codex
- CUCursor CLI
A real browser video editor with a multitrack timeline, AI captions, plain-English edits and a genuine MP4 export.
01 The hypothesis
Coding agents that can ship a CRUD-style SaaS app will struggle far more with media engineering, where timebase math, preview/export parity and real encoding can't be faked.
Video editing is where “it looks done” and “it works” drift furthest apart. The timeline has to keep consistent time without floating-point drift. The preview and the export have to come from one canonical project model. The export has to be a real H.264/AAC file whose audio lines up, and Cloudflare Workers can’t host native FFmpeg. Each agent has to choose a viable encoding architecture and prove it works.
The evaluator runs a fixed 10-step editing task with a shared media pack, then inspects the exported file.
02 The rules
A deployed app in which a tester can import supplied media, edit a short video, generate and edit captions, save and reopen the project, and export an MP4 whose video and audio match the timeline.
03 The contenders
The spec names these agents. Runs haven't started, so there are no repositories, timelines or results yet. Each run will get its own page here once it's recorded.
04 Head-to-head evaluation
05 Evidence
06 Observations & verdict
No observations yet. They're recorded during the runs.
No verdict yet.
A winner is only named once every build has been independently tested against the shared criteria, with the score components shown.
Not published yet
The video for this experiment will be embedded here once it is published.
Get notified on YouTube (opens in a new tab)Explore more
EXP-001Three coding agents, one 1,245-line product spec, eight hours each. Build a real AI travel SaaS and deploy it.
Five-on-five basketball in the browser, with real ball physics, keyboard control and an AI opponent.
A stationary 3D lane shooter where you steer an auto-firing squad, recruit soldiers and survive ten levels.