Model results
Humanity's Last Exam
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
Evaluation groups
Open a group to see its exact protocol and scores. Different configurations remain separate.
Model rankings
Open a group to compare scores within its reported protocol. Positions do not establish statistical significance.
- Humanity's Last ExamVersion not reported
Artificial Analysis
51 models with scores
Measurement date not reported
Scope · Broad expert-level knowledge evaluation; observed 2026-10-19; result date not supplied
Other reported results
These reports have no model ranking. Open a group for its evidence and the reason positions are withheld.
- Beam 1.0 501B A23Bunversioned
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-10-07
Scope · Registered model evaluation · dataset cais/hle · task hle · Beam 1.0 model card · No tools.
- Beam 1.0 501B A23Bunversioned
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-10-07
Scope · Registered model evaluation · dataset cais/hle · task hle · Beam 1.0 model card · With tools.
- Claude Opus 5.5unversioned
HLE w/ tools · Anthropic (reviewed publisher results)
Single-model result · Positions withheld
Measurement date 2026-09-22
Scope · Vendor-reported in Anthropic's Claude Opus 5.5 launch table; adaptive thinking at max effort unless …
Vendor-reported in Anthropic's Claude Opus 5.5 launch table; adaptive thinking at max effort unless noted; evaluated with production safeguards on, and where they intervened, cybersecurity tasks fell back to Claude Opus 4.8 and biology/frontier-LLM tasks to Claude Opus 5 (Anthropic says this likely lowers scores); Humanity's Last Exam with tools; dated to the announcement
- DeepSeek V4.1 Flashunversioned
HLE · DeepSeek model card (vendor-reported)
Single-model result · Positions withheld
Measurement date 2026-09-10
Scope · Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; Full HLE; without tools
- DeepSeek V4.1 Flashunversioned
HLE text-only · DeepSeek model card (vendor-reported)
Single-model result · Positions withheld
Measurement date 2026-09-10
Scope · Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; Text-only HLE subset; wi…
Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; Text-only HLE subset; without tools
- DeepSeek V4.1 Flashunversioned
HLE w/ tools · DeepSeek model card (vendor-reported)
Single-model result · Positions withheld
Measurement date 2026-09-10
Scope · Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; Tools enabled
- Muse Spark OpenVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-10-15
Scope · Registered model evaluation · Muse Spark Open model card
- DeepSeek V4.1 FlashVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-09-10
Scope · Registered model evaluation · DeepSeek-V4.1-Flash model card
- Hy4 previewVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-31
Scope · Registered model evaluation · Model Card
- GLM 5.3Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-29
Scope · Registered model evaluation · Model Card
- GLM 5.3 FlashVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-26
Scope · Registered model evaluation · GLM-5.3-Flash model card
- Qwen3.8 FlashVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-26
Scope · Registered model evaluation · Qwen3.8-Flash-Next model card
- Qwen3.8 27BVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-14
Scope · Registered model evaluation · Qwen3.8-27B model card
- Qwen3.8 2.4T A95BVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-12
Scope · Registered model evaluation · Model Card
- Nemotron 3.5 LightningVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-11
Scope · Registered model evaluation · NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model card
- Muse Glimmer 30BVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-10
Scope · Registered model evaluation · Muse Glimmer-30B model card
- Ling 3.0 FlashVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-06
Scope · Registered model evaluation · Model Card
- Inkling SmallVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-07-31
Scope · Registered model evaluation · Model Card
- Kimi K3Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-07-27
Scope · Registered model evaluation · Model Card
- InklingVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-07-19
Scope · Registered model evaluation · Model Card
- Hy3Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-07-06
Scope · Registered model evaluation · Model Card
- GLM 5.2Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-06-22
Scope · Registered model evaluation · Model Card
- Nemotron 3 UltraVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-06-03
Scope · Registered model evaluation · Model Card
- Step 3.7 FlashVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-05-23
Scope · Registered model evaluation · Model Card
- MiMo-V2.5-ProVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-27
Scope · Registered model evaluation · Model Card
- hle · hleVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2026-04-24
Scope · Registered model evaluation · Model Card
- Qwen3.6 27BVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-22
Scope · Registered model evaluation · Model Card
- Kimi K2.6Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-20
Scope · Registered model evaluation · Model Card
- Qwen3.6 35B A3BVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-16
Scope · Registered model evaluation · Model Card
- Hy3 previewVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-14
Scope · Registered model evaluation · Model Card
- GLM 5.1Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-07
Scope · Registered model evaluation · Model Card
- hle · hleVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2026-04-02
Scope · Registered model evaluation · Model Card
- hle · hleVersion not reported
Hugging Face eval result
3 models with scores · Positions withheld
Measurement date 2026-02-25
Scope · Registered model evaluation · Model Card
- Qwen3.5 397B A17BVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-02-16
Scope · Registered model evaluation · Model Card
- DeepSeek V3.2Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-02-13
Scope · Registered model evaluation · DeepSeek-V3.2 Technical Report
- hle · hleVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2026-02-13
Scope · Registered model evaluation · Model Card
- Kimi K2.5Version not reported
hle · default · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-02-13
Scope · Registered model evaluation · EvalEval
- Step 3.5 FlashVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-02-11
Scope · Registered model evaluation · Step 3.5 Flash Paper
- Kimi K2.5Version not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-02-04
Scope · Registered model evaluation · Model Card
- Kimi K2 ThinkingVersion not reported
hle · hle · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-02-03
Scope · Registered model evaluation · Model Card
- hle · hleVersion not reported
Hugging Face eval result
3 models with scores · Positions withheld
Measurement date 2026-01-28
Scope · Registered model evaluation · Model Card
- hle · hleVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2026-01-14
Scope · Registered model evaluation · Model Card
- hle · noneVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2025-08-13
Scope · Registered model evaluation · EvalEval
- hle · hleVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2025-08-05
Scope · Registered model evaluation · GPT-OSS Model Card
- Llama 4 MaverickVersion not reported
hle · none · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2025-04-10
Scope · Registered model evaluation · EvalEval
- Claude Opus 4.6Version not reported
Humanity's Last Exam · Humanity's Last Exam via Epoch AI
Single-model result · Positions withheld
Measurement date not reported
Scope · effort max · result date not supplied
- Gemini 3.1 Pro PreviewVersion not reported
Humanity's Last Exam · Humanity's Last Exam via Epoch AI
Single-model result · Positions withheld
Measurement date not reported
Scope · thinking high · result date not supplied
- GPT-5.1Version not reported
Humanity's Last Exam · Humanity's Last Exam via Epoch AI
Single-model result · Positions withheld
Measurement date not reported
Scope · no reasoning · result date not supplied
- Humanity's Last ExamVersion not reported
Hugging Face OpenEvals
16 models with scores · Positions withheld
Measurement date not reported
Scope · Latest published official benchmark result aggregated by OpenEvals · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
3 models with scores · Positions withheld
Measurement date not reported
Scope · effort high · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
2 models with scores · Positions withheld
Measurement date not reported
Scope · effort medium · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
15 models with scores · Positions withheld
Measurement date not reported
Scope · effort unspecified · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
3 models with scores · Positions withheld
Measurement date not reported
Scope · effort xhigh · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
11 models with scores · Positions withheld
Measurement date not reported
Scope · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
4 models with scores · Positions withheld
Measurement date not reported
Scope · thinking · effort unspecified · result date not supplied
- Humanity's Last ExamVersion not reported
Humanity's Last Exam via Epoch AI
2 models with scores · Positions withheld
Measurement date not reported
Scope · Thinking · effort unspecified · result date not supplied