Vibeleaderboard
← All Intel
Intel / post

Vals AI evaluates Mercury Decide: frontier accuracy at lowest cost

Source
x.com
Date
Vals AI@ValsAI

We tested Mercury Decide, a new model from @_inception_ai, on the same benchmark we used for TypeSafe's Jev. It matched frontier accuracy on claim verification at the lowest cost we have measured so far.

Why it matters

Shows a diffusion-based decision model matching frontier accuracy on claim verification at a quarter of Jev's cost, with confidence for routing. Latency grows with batched questions, so check your workload shape.

Terms in this piece · Glossary
  • calibration — How well a model's confidence matches reality — a calibrated model saying "90% sure" is right about 90% of the time.
More from Vals AI
Recommended reads
Comments

Checking sign-in…

Loading comments…