Cerebras CEO on the Future of Data Centres, Token Costs & Memory | Should US Companies Sell to China
Source
youtube.com
Author
20VC
Date
Why it matters
Persistent memory shortages and a data center backlog constrain how much inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → capacity exists and what it costs. A chipmaker CEO's view helps engineers plan for tokenThe chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.Full definition → pricing and availability.
Terms in this piece · Glossary
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
videoReplit CEO: Why the SaaS Apocalypse is Justified & Why Coding Models are Plateauing | Amjad Masad
videoInside Legora's Tech Stack: Why Token Maxing is Failing Enterprise Startups | Legora CTO
videoAndrew Feldman, Cerebras Co-Founder and CEO: The AI Chip Wars & The Plan to Break Nvidia's Dominance
videoOpen Models vs Frontier Models: Who Actually Wins? | The $100K Token Budget Every Engineer Will Need
videoCerebras CEO, Andrew Feldman on Why Raise $1BN and Delay the IPO & Why NVIDIA’s Worried About Growth20VC
videoGroq Founder, Jonathan Ross: OpenAI & Anthropic Will Build Their Own Chips & Will NVIDIA Hit $10TRN20VC