Model results

ArXivMath

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Official source

← All evaluation groups

ArXivMath August 2026

Source: MathArena (reviewed publisher results)
Version: 2026-08-native-harness
Measurement date: Not reported
Metric: % · Higher is better
Evaluation scope: Final-answer correctness; 57 questions; LLM equivalence judge; August 2026 dataset; harness=MathArena "deepcode" harness 0.3.1; configuration=DeepSeek-V4.1-Flash (Max); reasoning effort max; Python and SageMath tools; no internet; budget/time-limit instructions varied across models, see methodology https://matharena.ai/arxiv_august/; 95% CI 9.11%; cost per problem $0.43; model configuration https://matharena.ai/models/deepseek_deepseek_v41_flash; result date not supplied; captured 2026-10-15; publisher flags model release after competition release; publisher model endpoint deepseek/deepseek-v4.1-flash; publisher does not expose a dated provider revision

Fewer than two comparable models. No ranking is assigned. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

DeepSeek V4.1 Flash
deepseek/deepseek-v4.1-flash-20260910
43.86%
View modelEvidence independent