Lech Mazur Writing
github.com/lechmazur/writing- Category
- Developer Tools
- Listed in
- #43 Find AI benchmarks
- Type
- TOOL
- GitHub
- 458 stars
- Latest release
- benchmark-data-2026-08-23
- Date
About
Compares short stories that must incorporate specified elements using model-judged pairwise ratings. Evaluator changes and undocumented score bridging limit comparability over time; the current ratings are separate from archived absolute grades.
Why it made the leaderboard
Compare the task, benchmark version, harness, and grading method before using model scores to choose a model.
Tags
benchmarkevaluation
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.