
If curation buys the same gains as more compute, the training budget should move.
“Data quality is a compute multiplier because what it does is it it makes the learning curve steeper.”
Ari Morcos
“How do you do more? You make data better and now it's as if you had 100 times um the compute.”
Ari Morcos
“The internet is an extremely biased view of the world that does not represent the world uniformly at all.”
Ari Morcos
“data quality remains the single most underleveraged compute multiplier”
Ari Morcos
“it's almost always better to repeat highquality data than it is to show lowquality data at a certain point”
Ari Morcos
Checking sign-in…
Loading comments…