Vibeleaderboard

Greg Burnham

Viber rank454

Greg Burnham is head of benchmarks at Epoch AI. He develops evaluations and writes about what benchmark results can reveal about AI capability, learning and the automation of real work.[1][2]

Start with 9 Big questions benchmarks can help answer →
Greg Burnham

Education

Princeton University

BA in Mathematics

[1]

Links

Epoch AI profile X

Head of Benchmarks · Epoch AI

Career

Before Epoch AI, Burnham worked at Elemental Cognition and Bridgewater Associates. He holds a BA in mathematics from Princeton. His current work brings that mathematical background to the design and interpretation of AI evaluations.[1]

Contributions

Evaluating work by its own standards

With Kelly Hong, he co-authored Epoch’s automation report, which gives models tasks drawn from the organization’s actual work. Employees grade outputs against task-specific rubrics, combining objective checks with judgments about clarity and research quality. Examining the agents’ trajectories helps explain why an output failed. The study distinguishes reliable completion of well-defined steps from the judgment needed to choose topics, design experiments and follow through on an open-ended task.[3]

Spatial reasoning in a practical setting

His co-authored Furniture Assembly Benchmark work asks models to find mistakes in photos of partially assembled furniture. The task tests visual and spatial reasoning in a setting connected to physical repair and assembly. It provides a concrete domain to track over time, while the connection to useful real-world assistance remains a question to investigate rather than something established by a score alone.[4]

Ideas

Burnham argues that a benchmark should help answer a larger question than whether a model can complete one narrow task. His examples include whether systems improve through repeated experience, how performance generalizes across domains and whether an agent can complete a messy job rather than a self-contained assignment. He treats measurement as a way to investigate the forces behind AI’s impact, with realism and evaluation cost constraining what can be tested.[2]

Tools, writing & talks

Writing, research & talks

  • Start here

    A framework connecting benchmark design to questions about learning, generalization and economic impact.

    Begin with the first question about tasks versus whole jobs, then choose one of the nine questions to follow. It requires no technical setup and helps explain why different evaluations measure different things.

  • An evaluation of models on realistic internal work, graded by the organization’s own standards.

    Co-author with Kelly Hong[3]
  • An evaluation of visual and spatial reasoning through photos of partially assembled furniture.

    Co-author with Aiden Ament[4]
References

Latest source check 2026-10-30

  1. [1] Greg Burnham at Epoch AI

    epoch.ai · Checked 2026-10-30

  2. [2] Nine big questions benchmarks can help answer

    epochai.substack.com · Checked 2026-10-30

  3. [3] Can AI automate Epoch?

    epoch.ai · Checked 2026-10-30

  4. [4] AI reasoning about furniture assembly

    epoch.ai · Checked 2026-10-30

Greg Burnham | VibeLeaderboard