Vibeleaderboard
← All Intel
Intel / video

Claude Haiku 5.5 Is INSANE – This IS the BEST Cheap Model Yet!

Source
youtube.com
Author
Bijan Bowen
Date

Context

In one subway-game test of Anthropic's Claude Haiku 5.5, the presenter asked the to build a shooter in which the player rides a train between stations. He reports that the first version drew the player's weapon arm wrongly and froze when the train was due.

A second round of feedback, which also asked for more detail, fixed the arm but the game still froze at the train. He then gave the model the specific error he had seen in the browser console, the panel where a page logs runtime problems. After that attempt he says the freezing stopped and he reached a different station, with a note that he could not shoot while on the train. The episode shows one repair that needed three rounds and a concrete error message; it is a single presenter-reported run, not a measure of how reliably the model fixes bugs.

Terms in this piece · Glossary
  • Model — A computational system that uses learned patterns to produce an output from information supplied to it.
  • eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Read the source www.youtube.com
More from Bijan Bowen
Recommended reads
Comments

Checking sign-in…

Loading comments…