Vibeleaderboard
← All Intel
Intel / podcast

The 100-person AI lab that became Anthropic and Google's secret weapon | Edwin Chen (Surge AI)

Source
lennysnewsletter.com
Author
Lenny Rachitsky
Date

Context

Useful AI training data requires deciding what quality means for the task. Edwin Chen, founder of training-data company Surge AI, illustrates this with poetry: a response can meet requirements about length and subject while still lacking originality or emotional effect. Chen says the company combines contributor expertise, reviews, and observed performance to match people to tasks and assess their output, including testing whether the data improves models. Chen's account makes the quality standard itself part of the training work: what evaluators reward helps determine what the model learns to produce.

Key quotes

“We're basically teaching our models to chase dopamine instead of truth.”

Edwin Chen

“it's kind of crazy that these models can win IMO gold medals, but they still have trouble parsing PDFs.”

Edwin Chen

“It's literally optimizing your models for the types of people who buy tablets at the grocery store.”

Edwin Chen

“I would rather be Terrence Tao than Warren Buffett”

Edwin Chen

“You can actually build a successful company by simply building something so good that it cuts through all that noise.”

Edwin Chen
Chapters
  • 00:00Introduction to Edwin Chen
  • 04:48AI's role in business efficiency
  • 07:08Building a contrarian company
  • 08:55An explanation of what Surge AI does
  • 09:36The importance of high-quality data
  • 13:31How Claude Code has stayed ahead
  • 17:37Edwin's skepticism toward benchmarks
  • 21:54AGI timelines and industry trends
  • 28:33The Silicon Valley machine
  • 33:07Reinforcement learning and future AI training
  • 39:37Understanding model trajectories
  • 41:11How models have advanced and will continue to advance
  • 42:55Adapting to industry needs
  • 44:39Surge's research approach
  • 48:07Predictions for the next few years in AI
  • 50:43What's underhyped and overhyped in AI
  • 52:55The story of founding Surge AI
  • 01:02:18Lightning round and final thoughts
Read the source www.lennysnewsletter.com
More from Lenny Rachitsky
Recommended reads
Comments

Checking sign-in…

Loading comments…