Vercel's internal data assistant addressed a recurring interruption: employees' customer and product questions required a data scientist to write a query. The company's conference account describes rebuilding the assistant around a sandboxAn isolated environment where AI-generated code or agent actions run without being able to touch anything real.Full definition → containing company knowledge, with tools to list files, read them, and run commands.
A recurring process then turned common queries into reusable instructions called skills. That gives subsequent runs accumulated knowledge about the company's work. The account offers a concrete design approach for internal assistants: make relevant business context windowThe maximum amount of text a model can consider at once — its working memory for the current conversation or task.Full definition → available in a workspace the AI agentAn AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.Full definition → can navigate, and preserve useful procedures from recurring requests.
Terms in this piece · Glossary
sandbox — An isolated environment where AI-generated code or agent actions run without being able to touch anything real.
context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
videoWho Is Making This Request? Agent Auth 101 - Kamil Potrec, Keycard
videoStop Guessing Your vLLM Config: Benchmarking LLMs on Runpod - Chris Vela, Runpod
videoStop Giving Your Agent Tools. Give It a Sandbox - Mikyo King, Arize AI
videoWe Kept Rebuilding Our AI Agent. Here's What Survived - Fuad Ali, Arize AI
