When to Build Your Own Agent Harness | Harrison Chase, LangChain
- Source
- youtube.com
- Author
- Sequoia Capital
- Date
Context
Harrison Chase, co-founder and CEO of LangChain, describes an as the code around a model that decides what it sees and what happens with its response, in a loop that calls tools. Ready-made harnesses such as Claude Code or Codex work with particular vendors' models. In a Sequoia talk, Chase offers a rule of thumb, not a measured result: the more your task resembles what the models were trained on, the better an off-the-shelf harness will serve, and the further away it is, the more you should tune your own.
The example is legal AI. The overall task is far from model training, but editing files is not, and Chase says OpenAI and Claude models were each trained to edit files in different ways. The suggestion is a custom harness that still uses each model's own edit tool. Chase says LangChain's Deep Agents does this with model profiles that switch the edit implementation by model.
- agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
- context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
- eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
videoDavid Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience
videoCracking the Code on Offensive Security With AI ft XBOW CEO and GitHub Copilot Creator Oege de Moor
videoDeepMind's Pushmeet Kohli on AI's Scientific Revolution
videoHow to Scale AI Application Inference 100x ft. Fireworks’ Lin Qiao
Checking sign-in…
Loading comments…


