Vibeleaderboard
← All Intel
Intel / video

smol agents are all you need

Source
youtube.com
Author
Latent Space
Date

Context

Hugging Face's smolagents library lets a model write its actions as Python code instead of JSON calls, and its creator argues this works better. In a Latent Space interview, the creator uses the definition that an agent is a where a controls some of the execution flow, a spectrum from a simple router to a multi-step loop. In the usual JSON style, a model emits one tool name with arguments per step. With code, the creator says, a single step can run a loop with several tool calls and store results in variables, where JSON might need about twenty separate actions. The creator credits a research paper on code actions for the idea, and the library also includes a conventional tool-calling class.

The tradeoff is security: the creator says code agents bring big security challenges. The team reused a custom Python interpreter built earlier, uses the E2B service for now, and is adding Docker support.

Terms in this piece · Glossary
  • Tool — An operation that the software around a model makes available for the model to request, with a name, expected inputs and a kind of result.
  • Program — A set of instructions stored so that a computer can run it.
  • Large language model — A model trained on large amounts of data to process and generate language.
  • Sandbox — An enforced restriction that confines a process to specified files, network destinations and other resources, applied by the operating system, a container or a virtual machine.
Read the source www.youtube.com
More from Latent Space
Recommended reads
Comments

Checking sign-in…

Loading comments…