Clip transcript
able to check how well they can exploit high-value targets. This hadn't been done before. If we go look at public experiments out there, and we look at, for example, DARPA, they had looked at this question of fully autonomous where they said, "Hey, for synthetic problems that we can create, can AI do arbitrary code execution?" What we would consider a real hack. But when you go and you look at AIxCC or Cyber Gym or Bounty Bench, all they really checked is whether the AI could crash the program. Crashing a program is different than hacking it. You can't go steal someone's IP by simply crashing a program. So, this question of whether models could exploit high-value targets was actually open. So, what high-value target should we look at? We picked Chrome. And in particular, we picked the JavaScript Wasm interpreter called V8. Now, V8 is one of the things that maybe is foreign to you, but actually powers the internet. V8 is how Chrome executes JavaScript, and JavaScript is what's under the attacker's control. Put up a malicious website, it runs JavaScript, you can then exploit V8. It also runs Edge, it runs Node.js, it runs Cloudflare Edge Workers. If you've ever used an Edge Worker, it's actually running V8 where each tenant is a separate thread. It's crazy. And if you can find a vulnerability in V8, you can exploit all these systems. V8 is difficult to do because it goes beyond typical programs as far as security measures to try to keep it safe. For example, when you start looking at V8 and you look at the internals of this, there is a sandbox. And so, inside this sandbox is where you run your untrusted code, things like media, images, and so on. And inside the sandbox, we expect there to be vulnerabilities. In other words, if you can crash a in-sandbox object, it doesn't mean anything. That's expected behavior. What makes V8 a high-value target and what makes rewards start at 10,000 and go up to 100,000, or if you sell them on the black market, millions. Let's be frank here, people do that. is whether you can do an out-of-sandbox exploit. And that typically requires chaining multiple vulnerabilities together. So, TLDR, if you could give Chrome to an LLM and it could come up with a zero-day, you would essentially be able to hack nation-states at that point. It's a very worthwhile task to see how