Clip / AI Tools

Base models shifting from world knowledge to reasoning/agentic priors

From The Base Model Is Dead — Varun Singh, Arcee AI · ≈16:39

“base models have kind of moved from general, uh, human knowledge and world priors to reasoning and agentic behavior priors”

What’s in it

Explains why base models now build reasoning and agent priors, not just knowledge
Argues current chatbot design reflects a shift away from raw web-text priors
Flags that future interaction paradigms need new kinds of base-model priors

Watch this moment

Clip transcript

well in RL. Um, in conclusion, um, base models have kind of moved from general, uh, human knowledge and world priors to reasoning and agentic behavior priors. Um, of course, that's kind of, uh, reductive in the in the in a way that reasoning reasoners and agents are like the main way we see, uh, bots, uh, the main way we see these chatbots used now. But, if a new paradigm were to take off, like a new way of interacting with the models, um, it makes sense to like think of a base model as building a prior for that instead of, um, just building off like a a massive, uh, script of web text.