Vibeleaderboard
← Benchmark guide

Model results

GPQA Diamond

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Reviewed recommendation and limits

Use as a compact reference for expert-written science questions, alongside evidence that matches the scientific work you intend to do.

Original GPQA Diamond subset. Preserve prompt, answer extraction, tools, sampling and aggregation. Keep main, extended and third-party corrected subsets separate.. Imported groups below may use different protocols; this review does not certify each run. The static 198-question subset has limited statistical power and exposure risk. Its expert filtering does not make it representative of scientific practice. A Google-proof collection process does not prove present-day contamination resistance.

Publisher results GPQA paper

Evaluation groups

Open a group to see its exact protocol and scores. Different configurations remain separate.

Model rankings

Open a group to compare scores within its reported protocol. Positions do not establish statistical significance.

  • GPQAVersion not reported

    Artificial Analysis

    36 models with scores

    Measurement date not reported

    Scope · Graduate-level science questions; observed 2026-10-19; result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    5 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort 16K · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    6 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort 32K · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    2 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort 59K · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    30 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort high · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    22 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort low · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    25 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort max · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    12 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort medium · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    9 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort minimal · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    13 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort xhigh · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    25 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · no reasoning · result date not supplied

  • GPQA DiamondVersion not reported

    Epoch AI Benchmarking Hub

    70 models with scores

    Measurement date not reported

    Scope · Epoch AI run · task v1 · result date not supplied

Other reported results

These reports have no model ranking. Open a group for its evidence and the reason positions are withheld.

  • Beam 1.0 501B A23Bunversioned

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-10-07

    Scope · Registered model evaluation · dataset Idavidrein/gpqa · task diamond · Beam 1.0 model card

  • DeepSeek V4.1 Flashunversioned

    GPQA Diamond · DeepSeek model card (vendor-reported)

    Single-model result · Positions withheld

    Measurement date 2026-09-10

    Scope · Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; Harness not specified in…

    Vendor-reported; reasoning effort 100; Pass@1; temperature 1.0, top_p 0.95; Harness not specified in the comparison table

  • Muse Spark OpenVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-10-15

    Scope · Registered model evaluation · Muse Spark Open model card

  • DeepSeek V4.1 FlashVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-09-10

    Scope · Registered model evaluation · DeepSeek-V4.1-Flash model card

  • Hy4 previewVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-08-28

    Scope · Registered model evaluation · Model Card

  • Qwen3.8 FlashVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-08-26

    Scope · Registered model evaluation · Qwen3.8-Flash-Next model card

  • Qwen3.8 27BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-08-14

    Scope · Registered model evaluation · Qwen3.8-27B model card

  • Qwen3.8 2.4T A95BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-08-12

    Scope · Registered model evaluation · Model Card

  • Nemotron 3.5 LightningVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-08-11

    Scope · Registered model evaluation · NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 model card

  • Muse Glimmer 30BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-08-10

    Scope · Registered model evaluation · Muse Glimmer-30B model card

  • Inkling SmallVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-07-31

    Scope · Registered model evaluation · Model Card

  • Kimi K3Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-07-27

    Scope · Registered model evaluation · Model Card

  • InklingVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-07-19

    Scope · Registered model evaluation · Model Card

  • Hy3Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-07-06

    Scope · Registered model evaluation · Model Card

  • GLM 5.2Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-06-22

    Scope · Registered model evaluation · Model Card

  • Nemotron 3 UltraVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-06-03

    Scope · Registered model evaluation · Model Card

  • Granite 4.1 8BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-29

    Scope · Registered model evaluation · Model Card

  • MiMo-V2.5-ProVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-27

    Scope · Registered model evaluation · Model Card

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    2 models with scores · Positions withheld

    Measurement date 2026-04-24

    Scope · Registered model evaluation · Model Card

  • Qwen3.6 27BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-22

    Scope · Registered model evaluation · Model Card

  • Kimi K2.5Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-21

    Scope · Registered model evaluation · EvalEval

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    3 models with scores · Positions withheld

    Measurement date 2026-04-20

    Scope · Registered model evaluation · EvalEval

  • Kimi K2.6Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-20

    Scope · Registered model evaluation · Model Card

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    2 models with scores · Positions withheld

    Measurement date 2026-04-19

    Scope · Registered model evaluation · EvalEval

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    2 models with scores · Positions withheld

    Measurement date 2026-04-18

    Scope · Registered model evaluation · EvalEval

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    6 models with scores · Positions withheld

    Measurement date 2026-04-17

    Scope · Registered model evaluation · EvalEval

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    7 models with scores · Positions withheld

    Measurement date 2026-04-16

    Scope · Registered model evaluation · EvalEval

  • Qwen3.6 35B A3BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-16

    Scope · Registered model evaluation · Model Card

  • Hy3 previewVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-14

    Scope · Registered model evaluation · Model Card

  • GLM 5.1Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-04-07

    Scope · Registered model evaluation · Model Card

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    3 models with scores · Positions withheld

    Measurement date 2026-04-02

    Scope · Registered model evaluation · Model Card

  • Mistral Small 4Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-03-16

    Scope · Registered model evaluation · Model Card

  • Qwen3.5-9BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-03-02

    Scope · Registered model evaluation · Model Card

  • DeepSeek V3.2Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-02-28

    Scope · Registered model evaluation · DeepSeek-V3.2 technical report

  • Qwen3.5 397B A17BVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-02-16

    Scope · Registered model evaluation · Model Card

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    2 models with scores · Positions withheld

    Measurement date 2026-02-13

    Scope · Registered model evaluation · Model Card

  • Step 3.5 FlashVersion not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-02-11

    Scope · Registered model evaluation · Step 3.5 Flash Paper

  • gpqa · diamondVersion not reported

    Hugging Face eval result

    4 models with scores · Positions withheld

    Measurement date 2026-01-27

    Scope · Registered model evaluation · Model Card

  • GLM 4.7Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-01-21

    Scope · Registered model evaluation · Model Card

  • Qwen3 Next 80B A3B ThinkingVersion not reported

    gpqa · gpqa diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-01-16

    Scope · Registered model evaluation · Model Card

  • Qwen3 Next 80B A3B InstructVersion not reported

    gpqa · gpqa diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2026-01-15

    Scope · Registered model evaluation · Model Card

  • DeepSeek V3Version not reported

    gpqa · diamond · Hugging Face eval result

    Single-model result · Positions withheld

    Measurement date 2025-03-19

    Scope · Registered model evaluation · EvalEval

  • Claude Opus 4.1Version not reported

    GPQA Diamond · Epoch AI Benchmarking Hub

    Single-model result · Positions withheld

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort 27K · result date not supplied

  • Claude Opus 4.6Version not reported

    GPQA Diamond · Epoch AI Benchmarking Hub

    Single-model result · Positions withheld

    Measurement date not reported

    Scope · Epoch AI run · task v1 · effort 64K · result date not supplied

  • GPQAVersion not reported

    Hugging Face OpenEvals

    17 models with scores · Positions withheld

    Measurement date not reported

    Scope · Latest published official benchmark result aggregated by OpenEvals · result date not supplied

GPQA Diamond model results | VibeLeaderboard