Model results
Terminal-Bench
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
Reviewed recommendation and limits
Start with Terminal-Bench 4.0 for terminal-based agent work. Compare the same task release, agent and resource settings.
Terminal-Bench 4.0.0 on Harbor. Preserve agent, model, reasoning effort, task resources, trial count and resolution-rate uncertainty. Earlier 2.0, 2.1 and 3.0 results remain separate.. Imported groups below may use different protocols; this review does not certify each run. Public solutions, reward hacking and task-specific tuning can inflate results. Earlier editions and vendor-reported runs do not establish the current reviewed protocol. Terminal completion is different from repository issue repair.
Terminal-Bench 4.0
- Source
- DeepSeek model card (vendor-reported)
- Version
- 4.0
- Measurement date
- 2026-09-10
- Metric
- % · Higher is better
- Evaluation scope
- Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; DeepSeek Harness Minimal; 1M context
Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.
DeepSeek V4.1 Flash
deepseek/deepseek-v4.1-flash-20260910
31.2%
View modelEvidence model-card-reported