New in Claude Code: claude plugin eval
See what value your plugin is adding, or if it needs more work.
You can create test cases, run your plugin or skill against those test cases, score those runs, then run each case again without the plugin to see the differences.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
Why it matters
Plugin and agent skillA reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.Full definition → authors can now quantify whether their Claude Code plugin actually improves outcomes by running the same test cases with and without it, closing a previously unmeasured gap.
