← All IntelClip / AI AgentsOpen-sourced clinically reviewed guardrail scenario datasets
From Evals-Driven Development for a Mental Health AI Coach — Akele Reed & Dave Revere, SonderMind · ≈15:57
A public shared baseline of single- and multi-turn scenarios, calibrated against real conversation patterns, that other teams in the space can test against immediately.
What’s in it
- A public shared baseline of single- and multi-turn scenarios, calibrated against real conversation patterns, that other teams in the space can test against immediately.
Clip transcript
systems we can, especially in mental health. Okay? And so, in that regard, a shared baseline matters. Right. The the problems that Sondermind is facing are not unique to us. Anyone working in this space is going to face some version of these. Okay. So that's why we decided to open source our data sets. Today you can get 200 input guardrail scenarios and 100 output guardrail scenarios. everyone clinically reviewed and calibrated against real conversation patterns, single and multi-turn scenarios across the spectrum of mental health. Now, make no mistake, this is not meant to replace creating your own learning loops, but a shared baseline matters, right? There might be real hurting people depending on your learning curve. So everything we've talked about today,
Comments
Sign in to comment.
Loading comments…