Model results
Harvey LAB (Legal Agent Benchmark)
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
Harvey LAB (Legal Agent Benchmark)
- Source
- Vals AI (reviewed publisher results)
- Version
- 1
- Measurement date
- Not reported
- Metric
- % · Higher is better
- Evaluation scope
- Vals overall task pass percentage, the mean of two judges after each requires all criteria to pass. Source benchmark version 1. Split unresolved: prose says held-out; machine dataset_type says public. GPT 5.5 judge uses medium reasoning; Claude Sonnet 4.6 judge is unmodified per Vals. Valkyrie, Vals model library, Harvey generation/grading protocol. Internet disabled. Tools: Read File, Edit File, Write File, Glob, Bash, Grep. Skills: docx, pptx, xlsx. DOCX redline grading repair reported, rubric unchanged. Judge prompt split for caching, with content otherwise unchanged per operator. Exact run commit, measurement date, run count and dataset revision unknown; result date not supplied. Page update 2026-10-16 is not measurement time. Registry absence does not establish absent fallback execution. Separate from Harvey initial results and criteria pass rate. Source model anthropic/claude-opus-4-8. Configuration {"provider":"Anthropic","temperature":1,"top_p":null,"max_output_tokens":128000,"reasoning":null,"reasoning_effort":null,"verbosity":null,"compute_effort":"max","harness":null}. Reported stderr 2.148; no confidence interval inferred. Fallback execution unknown. Identity basis Exact Atlas canonical ID.
Fewer than two comparable models. No ranking is assigned. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.
Claude Opus 4.8
anthropic/claude-opus-4-8
9.583%
View modelEvidence independent