← All IntelClip / CybersecuritySpeed as the core attacker-vs-defender variable; need for open, fast specialized models
From Training Frontier Models to Out-Think Hackers — Uri Rolls, Arithmetic & Thom Wolf, Hugging Face · ≈14:37
“The only way to replace the old stack is through the models.”
“I think also the only way to do that is through a real array of strong open source models and collaboration that we can post train on and that we can post train to each network and to each environment as well.”
“I think the danger is to say we're just going to rely on two company that everyone knows here to solve all of that for us”
What’s in it
- Explains a live-environment cyber benchmark starting from a real zero-day exploit
- Argues speed, not just accuracy, decides who wins attacker vs defender races
- Makes the case for open-source models over relying on two big AI labs
Clip transcript
leaps need to be and I really believe that with everything happening now it is critical that we get cyber capabilities to the point where um we can defend much much faster. The only way to replace the old stack is through the models. Um, and I'll pass it back to Thomas. I think also the only way to do that is through a real array of strong open source models and collaboration that we can post train on and that we can post train to each network and to each environment as well. Yeah. So, as you saw this benchmark is quite different from mythos type of uh we read the code and we find the vulnerabilities. Here basically the model is operating in a real environment where you know there's a authentification place somewhere doesn't know what's there then there's another like network like um like microservices you need to access and use and it has basically zero information of that and it all start like you show by a zero zero day vulnerability that we have so everything is new so I think there's there's a lot of research uh to be done and understand how models can actually understand and work on that and so the First step is getting some good data. So the idea is to have some good benchmarks starting have some good data on how this is operating. I think the second step is being able to fine-tune models and try to understand how we can pro protect against that right and and the big challenge here is going to be speed. So you already told that several times going to be the speed of attacker versus defense, right? When they start to enter, you have to be able to see what's happening and catch them. and speed will be where you know you you want to have a specialized model that's maybe running on specialized hardware and actually is is going to be very important and here I think the the danger is to say we're just going to rely on two company that everyone knows here to solve all of that for us I think the solution is just to take our future and say well it's going to be a speed challenge we're going to train our model we're going to run them fast and make them available to basically every company who wants to be
Comments
Sign in to comment.
Loading comments…