
Storing too many tools in your context window increases latency and can lead to wrong tool selection. In this demo, we used LFM2.5-ColBERT-350M as a filter to only select the five most relevant tools among 151 options. It's fast and reliable, even without any specific fine-tuning. Try the demo on @huggingface! https://t.co/XhAMqTDzKT And learn more on our blog:
Large tool catalogs inflate latency and cause wrong tool picks. A small late-interaction retriever in front of the model keeps short and selection accurate without any .
Checking sign-in…
Loading comments…