← All IntelClip / EducationSurviving cloud contention via SKU flexibility
From Fireside Chat: Simon Eskildsen on Building Turbopuffer · ≈41:19
“We're just very fortunate that it's very easy for us to run lots of turbuffer clusters because all we need are like a few CPUs and NVME SSDs and then S3 and then we're in a good place.”
“But there's lots of changes that we can make even to the architecture um to try to protect from from a lot of this.”
“Now I'd rather spend that engineering effort on other things but we are very very good at using a lot of very different SKs, right?”
What’s in it
- Reveals how cloud CPU shortages trace back to power grid constraints
- Explains turbuffer's hardware-agnostic design: just CPUs, NVMe SSDs, and S3
- Names the specific GCP instance types (C4D, Z4D, C4A) that perform best
Clip transcript
fight behind the scenes that is maybe not as visible. >> Exactly. And I mean you you work with the clouds right you work with them to talk about which regions have um have CPU which regions are getting it comes down to power right of like okay well where is the power which is generally where they're going to ship the new CPUs. Um and so we have to work with some of our biggest customers on that. So these are real constraints right that are that are making our way to us. We're just very fortunate that it's very easy for us to run lots of turbuffer clusters because all we need are like a few CPUs and NVME SSDs and then S3 and then we're in a good place. But there's lots of changes that we can make even to the architecture um to try to protect from from a lot of this. Now I'd rather spend that engineering effort on other things but we are very very good at using a lot of very different SKs, right? So we don't need everything to be a particular CPU or instance type. We can run with many even many different types of machine types. Um >> Q meaning that's the it's a fancy name for like the different machine types. >> Yes. Exactly. Right. Like you know C4D or I AG or whatever they're called. >> What's your favorite one? >> Um we really like right now the um C4s on uh GCP. >> GCP. >> Um the Z4Ds are also performing really well um now that we've done done a bunch of of um of optimizations to them. Um those are really really great machine types. Uh we really like those. Um and then the ARM C4As as well um on on GCP. Um we like those. But I think that in
Comments
Checking sign-in…
Loading comments…