Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI

Explains how pretraining decisions on scale, data and compute drive the model capabilities you build on, helping you anticipate where model progress comes from.

• pretraining — The first, biggest phase of building a model: training it on enormous amounts of text so it learns language, facts, and reasoning in general.
• alignment — The work of making AI systems actually pursue what their builders and users intend, rather than something subtly or dangerously different.

• videoThe Model-Agnostic AI Platform Betting That No Single Lab Will Win
• videoWhat Top AI Labs Are Really Doing With Observability
• videoHow Intelligent Is AI, Really?
• videoRecursion Is The Next Scaling Law In AI

• videoThe Breakthroughs Needed for AGI Have Already Been Made: OpenAI Former Research Head Bob McGrewSequoia Capital
• videoBuilding the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan AnilSequoia Capital
• podcastAnthropic’s first technical PM on token maxing, the jagged edge, and living in the future | Dianne PennLenny Rachitsky

Checking sign-in…

Loading comments…