OpenAI's Greg Brockman: Why Human Attention Is the New Bottleneck
Source
youtube.com
Author
Sequoia Capital
Date
Why it matters
A direct statement of OpenAI's compute economics and why attentionThe mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.Full definition →, not model capability, becomes the limiting factor, which informs how you design AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → workflows and plan around capacity.
Terms in this piece · Glossary
attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
videoMaking the Case for the Terminal as AI's Workbench: Warp’s Zach Lloyd
videoHow Cursor Trained Composer on Fireworks: Distributed Infrastructure for High-Performance RL
videoHow Ricursive Intelligence’s Founders are Using AI to Shape The Future of Chip Design
videoGoogle DeepMind's Logan Kilpatrick: Why the Model Eats the Harness
