FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management
Source
arxiv.org
Author
Jermyn Zhen Yong Bek, Zhuang Qiang Bok, Zhongtian Sun
Date
Why it matters
Curated agent skillA reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.Full definition → packages — procedural documents paired with executable components — measurably outperform both bare models and skills the AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → writes for itself, on tasks demanding point-in-time data and auditable structured outputForcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.Full definition →. Useful evidence for how to invest in agent scaffolding.
Terms in this piece · Glossary
benchmark — A standard public test set for comparing AI models — the shared scoreboards behind every "model X beats model Y" claim.
agent skill — A reusable instruction file that teaches an agent how to do one job well — the procedure, the tools, and what counts as done.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
structured output — Forcing a model's response to match a schema, so downstream code can parse it instead of guessing at prose.
articleAn Empirical Study of Agent Skills' Downstream UtilityYu Cheng, Dehai Zhao, Zhongxin Liu, Qing Huang, Zhenchang Xing, Xiaoxue Ren
articleEvaluating AI Agent Skill Performance with NVIDIA SkillEvaluatorMichelle Horton
articleGrounded Skill Synthesis from Code at Scale for Agentic IntelligenceYongqi Tong, Pan Wang, Hang Wang, Jianshe Li, Xin Zhang, Jiang-Ming Yang, Wei Wu