🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing
Source
Brandon Anderson
Author
Brandon Anderson
Date
Terms in this piece · Glossary
transformer — The neural network architecture behind modern AI models, built on attention — letting every word directly consider every other word in parallel.
Why it matters
Scaling laws that carried language don't transfer to chaotic multi-scale physics — the data isn't there, so architecture and physical priors carry the load. FourCastNet already matches supercomputer simulations on consumer GPUs.
