
Bare bash outperformed typed tool schemas by 5-25 points across two enterprise benchmarks while cutting up to 72%, and layering typed tools or synthesized tools on top of bash added no measurable gain.
articleThe Devil Is in the Interface: Evaluating How Tool Architecture Shapes Coding Agent BehaviorXiangzhe Xu, Hamidreza Saghir, Qianhui Wu, Marc-Alexandre C\^ot\'e, Tong Wang, Kiran Lakkaraju, Kexin Pei, Xiangyu Zhang
articleHarness Engineering in LLM Tool Use via Agent-Native Reusable Tool PrimitivesHaibo Jin, Suijin Wang, Xucheng Yu, Haojing Luo, Haohan Wang
articleBC-Bench: Evaluating Agentic Engineering in a Domain-Specific Language for ERPHaoran Sun, Klaus Marius HansenChecking sign-in…
Loading comments…