MediationBench – testing AI mediators in 62 simulated conflicts
Source
mediationbench.com
Author
hendler
Date
Why it matters
Offers an evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → design for multi-turn agents that must decide when to speak, wait, or end. Results are provisional and all parties are simulated, so treat rankings cautiously.
Terms in this piece · Glossary
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
