← All IntelClip / AI AgentsPlacing agents on the deterministic-vs-agency spectrum
From Building Closed-Loop Evals for a Multimodal Agent at Scale — Soumya Gupta & Jai Chopra, Uber · ≈4:18
A usable design frame: rules-based systems are controllable but brittle at scale, full agency is creative but unsafe, so the architecture is deliberately placed between the two.
What’s in it
- A usable design frame: rules-based systems are controllable but brittle at scale, full agency is creative but unsafe, so the architecture is deliberately placed between the two.
Clip transcript
and we want to operate at scale in a cost-efficient manner. So, agents are actually really well-suited to solve this problem. So, if you imagine a spectrum, on the one side, you've got something that's more deterministic. It's more rules-based. Um and uh you you have more control over it, but it's fairly it's a brittle system. It's not actually going to be able to scale for the entire marketplace. Imagine the other side, you provide an agent with obviously a lot of creativity, it has a lot of agency. Um and that's actually what we want to lean into, but we can't leave that unconstrained, right? Cuz we have certain safety and certain guardrails in place that we need to adhere to. So, we want to find a balancing act. Uh and that's kind of set the principle for the way that we think and design around agents and evals.
Comments
Sign in to comment.
Loading comments…