Entity tracking emerges in sub-billion parameter language models and exceeds human performance in naturalistic narratives
Source
Karolina Dro\.zd\.z, Micha Heilbron
Author
Karolina Dro\.zd\.z, Micha Heilbron
Published
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Small models may already carry discourse tracking ability that teams assume requires scale.
articleModular Cognitive Architecture Emerges in Large Language ModelsPengrui Han, Jacob Andreas, Evelina Fedorenko, Andrea Gregor de Varda
articleChildren, but not language models, show accelerating returns in word learningMichael C. Frank
articleGRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual SettingsKonstantin Dobler, Federico Scozzafava, Jonathan Janke, Mohamed Ali, Simon Lehnerer