Modular Cognitive Architecture Emerges in Large Language Models
- Source
- arxiv.org
- Author
- Pengrui Han, Jacob Andreas, Evelina Fedorenko, Andrea Gregor de Varda
- Date

Context
Language models may develop groups of internal units that specialize in different kinds of tasks. Across 46 tasks involving language, formal reasoning, understanding other minds and reasoning about the physical world, researchers report that related tasks recruited overlapping units, while tasks from different domains recruited distinct ones. Their abstract compares that pattern with functional specialization in the human brain.
The finding suggests a way to investigate how different capabilities are organized inside a model. The authors propose that modularity could be a general organizing principle of intelligence; the reported similarity does not establish that every intelligent system must use this arrangement.
articleRecursive Language Models Generalize Out of DomainChenxiao Yang, Zhiyuan Li, David McAllester, Nathan Srebro
articleTowards a Characterization of Microservice Architectures Generated by Large Language ModelsJos\'e Renan, Ademar Sousa, Emanuel Dantas, Danyllo Albuquerque, Mirko Perkusic, Kyller Gorg\^onio, Angelo Perkusich
articleInduction and Inquiry via Probabilistic Reasoning over Language and CodeWasu Top Piriyakulkij, Sam Acquaviva, Cassidy Langenfeld, Joshua Tenenbaum, Kevin Ellis
Checking sign-in…
Loading comments…