Model results
ArXivMath
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
ArXivMath August 2026
- Source
- MathArena (reviewed publisher results)
- Version
- 2026-08-native-harness
- Measurement date
- Not reported
- Metric
- % · Higher is better
- Evaluation scope
- Final-answer correctness; 57 questions; LLM equivalence judge; August 2026 dataset; harness=MathArena "grok" harness 1.0.40; configuration=Grok 4.7 (xhigh); reasoning effort xhigh; Python and SageMath tools; no internet; budget/time-limit instructions varied across models, see methodology https://matharena.ai/arxiv_august/; 95% CI 9.78%; cost per problem $7.95; model configuration https://matharena.ai/models/xai_grok_47; result date not supplied; captured 2026-10-15; publisher flags model release after competition release; publisher model endpoint x-ai/grok-4.7; publisher does not expose a dated provider revision
Fewer than two comparable models. No ranking is assigned. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.
Grok 4.7
x-ai/grok-4.7-20260916
46.49%
View modelEvidence independent