Model results

MMMU-Pro

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Reviewed recommendation and limits

Prefer Pro to original MMMU when testing whether a model actually needs to understand the image.

MMMU-Pro standard and vision-only settings remain separate. Imported groups below may use different protocols; this review does not certify each run. Original MMMU test answers are public; inspect the Pro release separately. The project leaderboard is dated September 2025. Keep standard and vision-only settings separate.

Publisher results MMMU-Pro paper

← All evaluation groups

MMMU_Pro · mmmu pro standard 10 options

Source: Hugging Face eval result
Version: Not reported
Measurement date: 2026-07-31
Metric: % · Higher is better
Evaluation scope: Registered model evaluation · Model Card

Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

Inkling Small
thinkingmachines/inkling-small-20260730
74%
View modelEvidence Evidence class unreported