Vibeleaderboard
← All Intel
Intel / post

Epoch AI: subagents barely help on long-horizon EBR-bench

Source
x.com
Date
EpochAIResearch@EpochAIResearch

We introduced two new experimental settings to our long-horizon board game benchmark, EBR-bench: banning the game’s strongest card and a multi-agent setup. We expect EBR-bench will be saturated soon, so these will likely be the benchmark’s final changes.

Context

EBR-bench is Epoch AI's long-horizon board game , built on Earthborne Rangers. Epoch's update, announced in this post, adds two experimental settings. In the first, a version lets a use up to four subagents, helper agents that handle parts of the task.

Epoch found topline scores were not significantly affected. Subagents increased how many deck types most models tried, significantly only for Claude Opus 5, while GPT-6 Astra already explored many deck types as a single agent.

The second setting bans a card. OpenAI's GPT-6 Astra achieved a perfect score in over half its attempts on the original benchmark, using a card that lets it bypass the game's default time constraints. Epoch banned it going forward and says the ban did not significantly affect the other models' topline scores. It expects the benchmark to saturate within a few months.

Terms in this piece · Glossary
  • Benchmark — A fixed set of tasks with a stated way of scoring them, used to compare models or setups.
  • multi-agent — Using several AI agents on one problem — splitting work in parallel, checking each other, or filling different roles like planner and reviewer.
  • Model — A computational system that uses learned patterns to produce an output from information supplied to it.
  • Harness engineering — Designing the full environment and feedback system around an agent.
More from EpochAIResearch
Recommended reads
Comments

Checking sign-in…

Loading comments…