Model results
GAIA
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
GAIA
- Source
- GAIA community submissions (reviewed publisher results)
- Version
- 2023-test
- Measurement date
- Not reported
- Metric
- % · Higher is better
- Evaluation scope
- Submitted system 'gpt-4o-mini-2024-07-18'. Community-submitted answers; model identity is submitter-declared and execution is not independently verified. GAIA 2023 test split, 301 questions; operator-reported normalized quasi-exact-match accuracy. Declared model family 'GPT-4o mini'. Submission date 2024-10-08; measurement date unreported. Submitter organization unreported. Pinned dataset revision 8be3178cbf290fdd9956f40514c7fa1ef4f780e0, zero-based source row 59. Tools, exact backend revision when undated, runtime agent commit, sampling settings, execution budget and repeats unreported. Current pinned scorer documents the method, not the code revision used for every historical submission. Submission-specific cohort; no cross-model ranking or independent reproduction. Contamination and manual intervention are not ruled out. Original submitted system prompt: You are a general AI assistant. I will ask you a question. Report your thoughts, and finish your answer with the following template: FINAL ANSWER: [YOUR FINAL ANSWER]. YOUR FINAL ANSWER should be a number OR as few words as possible OR a comma separated list of numbers and/or strings. If you are asked for a number, don't use comma to write your number neither use units such as $ or percent sign unless specified otherwise. If you are asked for a string, don't use articles, neither abbreviations (e.g. for cities), and write the digits in plain text unless specified otherwise. If you are asked for a comma separated list, apply the above rules depending of whether the element to be put in the list is a number or a string.
Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.
GPT-4o-mini (2024-07-18)
openai/gpt-4o-mini-2024-07-18
4.651162790697675%
View modelEvidence aggregated