← All IntelClip / AI ToolsThe 12-cell matrix and questions that test argument architecture, not recall
From The Miranda Hypothesis: How Hamilton Poisoned Persona Evals - Jacob E. Thomas, Results Gen · ≈39:27
A directly copyable eval design: four moments by three conditions by five historian-written diagnostic questions on documented fault lines, yielding 60 scored response units.
What’s in it
- A directly copyable eval design: four moments by three conditions by five historian-written diagnostic questions on documented fault lines, yielding 60 scored response units.
Clip transcript
Put the spectrum and the prisms together and you get the experimental matrix. Four moments, three conditions, 12 cells. Each cell gets the same five diagnostic questions, 60 response units scored against one rubric. Read it as the conceptual model. Every column is a quality of prism, every row is a frequency we're trying to isolate. The historian wrote five diagnostic questions, each mapping a documented fault line in Lincoln's evolution. A place where the four Lincolns demonstrate different reasoning. They don't test recall. A model recovers dates from training. They test the architecture of an argument the figure could have made at one moment and not another. Executive war power. The meaning of free labor. When is When is it right to break positive law for a higher obligation? What becomes of free people and what equal means and whether it has changed.
Comments
Checking sign-in…
Loading comments…