attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Why it matters
Specific documented cases of benchmarkA standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.Full definition → gaming and shifting leaderboard rankings show why a model's public evalA repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.Full definition → score can diverge sharply from its real capability, worth applying before trusting any single leaderboard.
