🔬“We have foundation models for language, not for physics” — Anima Anandkumar, Bren Professor of Computing

Scaling laws that carried language don't transfer to chaotic multi-scale physics — the data isn't there, so architecture and physical priors carry the load. FourCastNet already matches supercomputer simulations on consumer GPUs.

• transformer — The neural network architecture behind modern AI models, built on attention — letting every word directly consider every other word in parallel.

• article🔬 An Oscar, Two Asteroids, and the Algorithm in Your sklearn: John Platt on AI for Science

• video🔬 Why Transformers Hit a Wall the Moment Physics Shows Up — Anima Anandkumar, CaltechLatent Space
• videoTrillion Token Context. No, Really — Anima Anandkumar & Benedikt Jenik, Accelerated UnderstandingLatent Space
• videoAdaption Labs: Gradient-Free Continual Learning — Sara Hooker, AdaptionAI Engineer

Checking sign-in…

Loading comments…