Recursive Self-Improvement: from Auto Research to Superintelligence — Richard Socher, Recursive

Describes an automated research system claimed to beat human-plus-agent baselines on optimization tasks in under two days, and the reward hacking risks that come with it.

• Socher says Recursive's system found NVIDIA GPU kernel improvements without relying on a team of CUDA experts.
• He argues AI hard-takeoff scenarios may underestimate physical, compute and economic constraints.
• Socher warns against regulating intelligence itself rather than specific AI applications.
• He says he is less bullish on world models, and the episode also includes his critique of Anthropic's constitution and constitutional AI.

• LLM — A large language model — the neural network behind tools like Claude and ChatGPT, trained on huge amounts of text to predict what comes next.
• AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.

• video🔬Bio-security is an AI Arms Race - Eric Nguyen (CEO, Radical Numerics)
• video🔬 Google's AI Scientist Started as an Attempt to Automate Kaggle — John Platt, Google Fellow
• videoA Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI
• videoOrbs: Shifting Coding to Cloud — Quinn Slack, Amp Code

• articleHumanity’s Last Invention — Richard Socher of Recursivewww.latent.space
• podcastAI researchers debate how close we are to recursive self-improvementDwarkesh Patel
• podcastRyan Greenblatt – Human level AIs might build runaway superintelligences by 2032Dwarkesh Patel

Checking sign-in…

Loading comments…