FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management
Source
Jermyn Zhen Yong Bek, Zhuang Qiang Bok, Zhongtian Sun
Author
Jermyn Zhen Yong Bek, Zhuang Qiang Bok, Zhongtian Sun
Date
Terms in this piece · Glossary
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
structured output — Forcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.
Why it matters
Curated agent skillA reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.Full definition → packages — procedural documents paired with executable components — measurably outperform both bare models and skills the AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → writes for itself, on tasks demanding point-in-time data and auditable structured outputForcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.Full definition →. Useful evidence for how to invest in agent scaffolding.
articleEvaluating AI Agent Skill Performance with NVIDIA SkillEvaluatorMichelle Horton
articleBacktrader-Bench: Benchmarking LLM Agents on Algorithmic Trading with Self-Generated MCQsRuoxi Zhao, Maziar Raissi
articleBetter, Faster, Stronger: Programmatic Skill Learning Best Reduces Agent CostZixi Huang, Xiheng Wang, Andrew Wang, William Jurayj, Bernal Jim\'enez Guti\'errez, Daniel Khashabi, Nicholas Andrews