Model results
GAIA
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
GAIA
- Source
- GAIA community submissions (reviewed publisher results)
- Version
- 2023-test
- Measurement date
- Not reported
- Metric
- % · Higher is better
- Evaluation scope
- Submitted system 'magic_v0.1'. Community-submitted answers; model identity is submitter-declared and execution is not independently verified. GAIA 2023 test split, 301 questions; operator-reported normalized quasi-exact-match accuracy. Declared model family 'gemini-2.5-pro'. Submission date 2025-07-07; measurement date unreported. Submitter organization unreported. Pinned dataset revision 8be3178cbf290fdd9956f40514c7fa1ef4f780e0, zero-based source row 517. Tools, exact backend revision when undated, runtime agent commit, sampling settings, execution budget and repeats unreported. Current pinned scorer documents the method, not the code revision used for every historical submission. Submission-specific cohort; no cross-model ranking or independent reproduction. Contamination and manual intervention are not ruled out. Original submitted system prompt:
Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.
Gemini 2.5 Pro
google/gemini-2.5-pro
42.524916943521596%
View modelEvidence aggregated