Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil
Source
youtube.com
Author
Sequoia Capital
Date
Why it matters
Researchers who led reasoning and pretrainingThe first, biggest phase of building a model: training it on enormous amounts of text so it learns language, facts, and reasoning in general.Full definition → work argue that reinforcement learning is not the end of learning from experience. This signals where model training methods may move next.
Terms in this piece · Glossary
pretraining — The first, biggest phase of building a model: training it on enormous amounts of text so it learns language, facts, and reasoning in general.