Model results

GPQA Diamond

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Reviewed recommendation and limits

Use as a compact reference for expert-written science questions, alongside evidence that matches the scientific work you intend to do.

Original GPQA Diamond subset. Preserve prompt, answer extraction, tools, sampling and aggregation. Keep main, extended and third-party corrected subsets separate.. Imported groups below may use different protocols; this review does not certify each run. The static 198-question subset has limited statistical power and exposure risk. Its expert filtering does not make it representative of scientific practice. A Google-proof collection process does not prove present-day contamination resistance.

Publisher results GPQA paper

← All evaluation groups

gpqa · diamond

Source: Hugging Face eval result
Version: Not reported
Measurement date: 2026-04-16
Metric: % · Higher is better
Evaluation scope: Registered model evaluation · EvalEval

Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

gpt-oss-120b
openai/gpt-oss-120b
80.8%
View modelEvidence Evidence class unreported
Nemotron 3 Super
nvidia/nemotron-3-super-120b-a12b-20230311
77.3%
View modelEvidence Evidence class unreported
Llama 3.3 70B Instruct
meta/llama-3.3-70b-instruct
51.5%
View modelEvidence Evidence class unreported
Command A
cohere/command-a-03-2025
50.5%
View modelEvidence Evidence class unreported
Llama 4 Scout
meta/llama-4-scout-17b-16e-instruct
46.5%
View modelEvidence Evidence class unreported
Gemma 2 27B
google/gemma-2-27b-it
40.9%
View modelEvidence Evidence class unreported
Llama 3.2 1B Instruct
meta/llama-3.2-1b-instruct
18.7%
View modelEvidence Evidence class unreported