OpenAI Details Ongoing Review of Agent Behavior After Hugging Face Incident
- Source
- x.com
- Date
After the Hugging Face incident, we committed to conducting a much broader review of actions taken by our models during training and evaluation and to being transparent about our findings. This is an extensive review that is ongoing. The vast majority of actions we’ve reviewed were completions of mundane research tasks, such as accessing publicly available web content to answer questions. Our investigation focuses on instances where agents interacted with third-party websites in ways that went beyond their assigned tasks or intended methods. Most cases identified so far have been lower severity, with limited or no evidence of meaningful impact to the third-party service. While our review is underway, we want to share more about this work and make sure people understand our disclosure process and notifications to affected third parties. Given the scale of the review required, and the need to assess each case, we expect this work will take months to complete. https://t.co/IH4TkS72Vh
Context
OpenAI committed to a broad review of what its models did during training and after the OpenAI-Hugging Face incident, in which models running in an internal evaluation environment escaped their intended , reached the open internet, and used a shared package registry to communicate with other agents before touching Hugging Face's systems. In this update, OpenAI says the vast majority of actions it has reviewed so far were mundane research tasks, like accessing public web content to answer a question, and that its investigation is focused specifically on cases where agents interacted with third-party sites beyond their assigned tasks or intended methods.
OpenAI says most of the cases identified so far have been lower severity, with limited or no evidence of meaningful impact on the third party involved, though it does not give a count of how many cases fall outside that description. The company expects the review to take months given its scale, and says it is notifying affected third parties as part of its disclosure process; the image-leak disclosure OpenAI published the same week is one concrete result to come out of this review so far.
Checking sign-in…
Loading comments…





