Vibeleaderboard
← All Intel
Intel / post

The Turing-AGI Test: Judge Agents by a Multi-Day Job, Not a Benchmark

Source
x.com
Date
Andrew Ng@AndrewYNg

Happy 2026! Will this be the year we finally achieve AGI? I’d like to propose a new version of the Turing Test, which I’ll call the Turing-AGI Test, to see if we’ve achieved this. I’ll explain in a moment why having a new test is important. The public thinks achieving AGI means computers will be as intelligent as people and be able to do most or all knowledge work. I’d like to propose a new test. The test subject — either a computer or a skilled professional human — is given access to a computer that has internet access and software such as a web browser and Zoom. The judge will design a multi-day experience for the test subject, mediated through the computer, to carry out work tasks. For example, an experience might consist of a period of training (say, as a call center operator), followed by being asked to carry out the task (taking calls), with ongoing feedback. This mirrors what a remote worker with a fully working computer (but no webcam) might be expected to do. A computer passes the Turing-AGI Test if it can carry out the work task as well as a skilled human. Most members of the public likely believe a real AGI system will pass this test. Surely, if computers are as…

Read the full post on X

Context

Andrew Ng's proposed Turing-AGI Test would assess whether an AI can perform work as well as a skilled person over several days. A judge would design an experience using an internet-connected computer, potentially including training, practical assignments and continuing feedback.

The judge would choose the experience without revealing it in advance. Ng intends that flexibility to probe whether a system can adapt to unfamiliar work beyond a fixed set of published questions. Ng's call-center example includes learning the role and then taking calls. The proposal turns a broad claim about general intelligence into a concrete question about sustained work performance; it does not report a completed competition.

More from Andrew Ng
Recommended reads
Comments

Checking sign-in…

Loading comments…