FMF Releases Jailbreak Rating Framework for Frontier Cyber Threats
Source
frontiermodelforum.org
Author
OpenAITop Viber
Date
Why it matters
Gives security and evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → teams a shared four-factor rubric for rating cyber jailbreaks so they can triage by risk and compare findings across labs. It is v1.0 and still untested for inter-rater consistency.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
