Vibeleaderboard
← All Intel
Intel / post

Epoch's Automation Reports test whether AI can do Epoch's own work

Source
x.com
Date
E
EpochAIResearch@EpochAIResearch

Can AI automate Epoch? We're introducing Epoch Automation Reports to evaluate frontier models on realistic, open-ended tasks drawn from our own work. Claude Fable 5.1 and GPT-6 Astra lead, yet they are far from fully automating Epoch’s work.

Horizontal bar graph displays average task performance scores for 6 top AI models, showing that none can autonomously complete Epoch's work to internal standards.
Why it matters

Shows where frontier models still fail on real research work: they miss house style and report experiment-setup errors as findings. Useful for judging how far to trust agents on open-ended tasks.

More from EpochAIResearch
Recommended reads
Comments

Checking sign-in…

Loading comments…