Vibeleaderboard
← All Intel
Intel / post

3D demos are a benchmark of their own, not a proxy for coding skill

Source
x.com
Date

The smartest code model in the world would not be good at 3d stuff unless it was trained specifically for it. A lot of the labs recently got a big pile of 3d training data and an RL environment to improve 3d skills. Take a look at the jump in 3d from Fable 5.1 to Opus 5.5. It's at least 4x better at 3d despite being a 5% better model at best. Clearly Meta didn't go hard on 3d for this release. Doesn't mean the model is bad. 3dmaxxing is a different type of benchmaxxing, don't overthink it. I'll take some fault here by sharing all the Fishslop demos. The 3d stuff is fun and cool as hell, but it's not a good representation of a model's real world code capability.

Why it matters

Strong 3D output can come from specialized training environments rather than better general coding. Judge a model on real-world code tasks, not viral 3D demos.

More from Theo - t3.gg
Recommended reads
Comments

Checking sign-in…

Loading comments…