Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal
Source
youtube.com
Author
Latent Space
Date
Why it matters
Explains why GPU capacity is sold in long fixed terms while AI workloads are bursty, and how pooled compute and sandboxes change cost and availability for engineers running agents and inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition →.
Terms in this piece · Glossary
sandbox — An isolated environment where AI-generated code or agent actions run without being able to touch anything real.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
videoAI in NYC: How Tenex Builds an AI-Native Engineering Team — Alex Lieberman & CJ Hess
videoThe Programmable Data Center — Evan Conrad, SF Compute
videoHigh Taste Testers: OpenAI Shipped Everything. What Actually Works?
videoHow to kill your SaaS: what we learned replacing a $43K/yr tool with AI agents
