Vibeleaderboard
← All Intel
Intel / article

Artificial Analysis Decision Index

Source
artificialanalysis.ai
Author
Artificial Analysis articles
Date
Why it matters

Single-call decision models are cheaper and faster than LLM for routing and classification. This index measures their and when they should abstain.

Terms in this piece · Glossary
  • hallucination — When a model states something false with full confidence — inventing facts, citations, or APIs that don't exist.
  • tool use — A model's ability to call external functions — run code, search the web, edit files — instead of only generating text.
  • structured output — Forcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.
  • calibration — How well a model's confidence matches reality — a calibrated model saying "90% sure" is right about 90% of the time.
Read the source artificialanalysis.ai
More from Artificial Analysis articles
Recommended reads
Comments

Checking sign-in…

Loading comments…