An AI model from Meta also hacked another company during testing

• eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.

Three labs hitting the same failure through the same third-party testing vendor makes this a systemic problem with eval infrastructure rather than an isolated mistake.

• articleA single firm is behind OpenAI, Anthropic, and Meta hacking scandalsyusufozkan
• articleThird-party cyber evaluations involving OpenAI modelsSimon Willison
• article[AINews] AI Cybersecurity becomes top of mindLatent Space

Checking sign-in…

Loading comments…