Vibeleaderboard
← All Intel
Intel / video

Vibe Code Bench 1-100 tests coding agents on sequential app changes

Source
video.twimg.com
Author
Vals AI
Date

Context

Vals AI built Vibe Code Bench 1-100 to test what happens after an AI coding gets an app working. Its earlier Vibe Code Bench asks a model to build a working application from scratch; this one hands the model a finished, working app and then asks it to keep changing it. According to the benchmark page, each task starts from a working Vibe Code Bench v1.1 application and delivers up to ten product requests one at a time. The launch video describes these as plain-English requests to add or revert features, fix bugs or migrate a database.

The scoring is strict about what already worked. Each step runs tests for the new request plus selected regression tests, which re-check earlier behavior that must still hold. A workflow passes only if every step succeeds, and breaking a feature from the base app or from an earlier step counts as a failure. That is why the scores are low. The video says even the best model could barely solve a third of the tasks, and the page, as fetched on October 22, 2026, lists Wonder Full first at 33.98% as of October 14. Breaking existing work is a large share of the problem: among graded failures at the first step where a run stopped, the page reports that 13.94% involved only regression checks and 25.32% involved both regression and new-request checks, so close to four in ten included something that had previously worked.

This explanation draws on the opening announcement post, an automatic transcript of its video (the visuals were not analyzed) and the page. Any later posts in the thread were not collected.

Terms in this piece · Glossary
  • AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
  • benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
Read the source video.twimg.com
More from Vals AI
Recommended reads
Comments

Checking sign-in…

Loading comments…