Vibeleaderboard
Index / tool
Visit github.com
Category
Developer Tools
Rank
No. 2165Tools index
Pricing
Open Source
Type
TOOL
Use case
Model & Agent Evaluation
GitHub
2 stars
Latest release
v0.1.0
Date

About

software-world-model is a benchmark for computer-use agents working in self-hosted business apps such as Invoice Ninja, Dolibarr and Odoo. After each episode it diffs the whole database, so it can report success, collateral damage, irreversible changes and false completion. This catches cases where an agent reports success while the data says otherwise, which a pass or fail check on the task alone would miss.

Tags

benchmarkcomputer-useai-agentsevaluationodoodatabase-diff

Tech Stack

Python

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.