Vibeleaderboard
← All Intel
Intel / video

Building the Cloud for AI Agents | AWS CEO Matt Garman

Source
youtube.com
Author
a16z
Date

Context

AWS deliberately reserves some AI computing capacity for startups, according to its chief executive, Matt Garman. Garman says large AI labs could buy every available accelerator, but AWS chooses not to sell to them alone because it wants to keep growing the wider ecosystem, gain some diversification, and support companies likely to become big customers over time. Startup access therefore depends partly on how AWS divides its available hardware among customers. Garman describes that allocation policy in the a16z interview.

An accepted request can still involve compromises. Garman says they recently saw that AWS says yes in some form to roughly 60% of the requests it eventually gets, sometimes later, in a different region, or with a configuration slightly different from what the customer wanted. This is the executive's own recollection of an internal figure, not an independently checked statistic. It suggests that startup access can mean a negotiated fit rather than the exact capacity requested. The interview details those adjustments.

Terms in this piece · Glossary
  • Agent — A system in which a model repeatedly chooses operations, a harness carries them out, and the results return to the model to inform its next choice.
Read the source www.youtube.com
More from a16z
Recommended reads
Comments

Checking sign-in…

Loading comments…