Morgan Stanley's ALPHALAB: Multi-Agent Research Across Optimization Domains — Brendan Rappazzo
- Source
- youtube.com
- Author
- AI Engineer
- Date

Context
Morgan Stanley's ALPHALAB research system is shifting toward tests designed by human experts before agents begin optimizing models. The team's presentation explains the problem with its earlier approach: an could build an evaluation, then spend substantial effort improving against a flawed test.
The described successor uses controlled environments where agents submit packaged models and receive scores. Researchers can separately inspect performance on held-out data that the agent does not see. This separates the feedback used to guide experimentation from the evidence used to judge its result. The system's proposed self-improvement depends on that measurement discipline; the talk does not establish realized trading returns.
- AI agent — An AI system that doesn't just answer once but works toward a goal in a loop — taking actions, reading the results, and deciding what to do next.
- multi-agent — Using several AI agents on one problem — splitting work in parallel, checking each other, or filling different roles like planner and reviewer.
- context window — The maximum amount of text a model can consider at once — its working memory for the current conversation or task.
- agent harness — The scaffolding around a model that turns it into a working agent — the loop, the tools it can call, and the rules for when to stop.
“it really felt possible for the first time with like with Opus 4.5 and with, you know, these harnesses like Claude Code and Codex”
“LLMs aren't malicious, but they can make, you know, very silly mistakes and if you're optimizing against a bad a bad eval, the whole thing kind of falls apart.”
“this is a lesson I learned over and over, like monthly, working with these models, you have to start with good eval.”
“to me evals and environments are the same thing. It's just you train in environments.”
“I think we're already seeing it with GLM 5.2, and so I really think all of your value as like an enterprise or human expert comes from building environments.”
Checking sign-in…
Loading comments…





