← All IntelClip / CybersecurityMining fresh zero-days to manufacture uncontaminated RL environments at scale
From Teaching AI to Find Real Vulnerabilities — David Brumley, Bugcrowd · ≈25:25
Describes the supply chain behind security RL — a vulnerability mining machine produces novel proofs of vulnerability so training data provably predates no model's pretraining.
What’s in it
- Describes the supply chain behind security RL — a vulnerability mining machine produces novel proofs of vulnerability so training data provably predates no model's pretraining.
Clip transcript
So for the next steps, I mean we only have a 20-minute talk here. One of the things that we are doing is we're taking these as really benchmarks to see where the frontier models stop, and then we're building reinforcement learning environments to help get models past that. The way that we go about this is we've done a a fairly curated approach where we take open-source software and we built a very extensive vulnerability mining machine based upon our work with DARPA over the last decade for novel vulnerability discovery. We find unique proofs of vulnerability. These are zero days no one else use and we use these to then build reinforcement learning environments. Why are we finding zero days? Well, we want to make sure that the models aren't simply memorizing and we know if it's a vulnerability they've never seen before that it can't at least be just memorizing that. We're able to do this at scale where some of our the companies that we work with we're providing up to 10,000 reinforcement learning environments per month to really accelerate their uh learning. We of course can't take credit for how
Recommended reads
articleGraph Is the Verifier: Agentic Reinforcement Learning for Interprocedural Vulnerability DetectionYikun Li, Ting Zhang, Jiakun Liu, Jinfeng Jiang, Yuheng Yieh, Yixin Yang, Wen Bin Leow, Yide Yin, Yintong Huo, Eng Lieh Ouh, Lwin Khin Shar, David Lo
videoTraining Frontier Models to Out-Think Hackers — Uri Rolls, Arithmetic & Thom Wolf, Hugging FaceAI Engineer- clipLiteLLM supply chain compromiseAI Engineer
Comments
Checking sign-in…
Loading comments…