software-world-model
github.com/shubhamjoshipromail-svg/software-world-model- Category
- Developer Tools
- Rank
- No. 2165Tools index
- Pricing
- Open Source
- Type
- TOOL
- Use case
- Model & Agent Evaluation
- GitHub
- 2 stars
- Latest release
- v0.1.0
- Date
About
software-world-model is a benchmark for computer-use agents working in self-hosted business apps such as Invoice Ninja, Dolibarr and Odoo. After each episode it diffs the whole database, so it can report success, collateral damage, irreversible changes and false completion. This catches cases where an agent reports success while the data says otherwise, which a pass or fail check on the task alone would miss.
Tags
benchmarkcomputer-useai-agentsevaluationodoodatabase-diff
Tech Stack
Python
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.