Vibeleaderboard
← All Intel
Intel / video

From Ambient Documentation to Clinical Intelligence — Chaitanya Asawa, Abridge

Source
youtube.com
Author
AI Engineer
Date

Context

Abridge, which develops AI for clinical conversations, describes evaluating responses against clinician-written criteria rather than a single reference answer. Its presentation summary explains that two physicians independently specify what a good response should contain. A third reconciles their criteria, and a fourth performs quality assurance before a judge scores responses against the resulting rubric. This accommodates multiple valid ways to answer while making the required content explicit. Separate judges assess safety, adversarial boundaries and tone. The approach makes clinician judgment part of the design; the description does not report a clinical-outcome comparison.

Terms in this piece · Glossary
  • eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Read the source www.youtube.com
More from AI Engineer
Recommended reads
Comments

Checking sign-in…

Loading comments…