Model results
MMMU-Pro
Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.
Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.
Reviewed recommendation and limits
Prefer Pro to original MMMU when testing whether a model actually needs to understand the image.
MMMU-Pro standard and vision-only settings remain separate. Imported groups below may use different protocols; this review does not certify each run. Original MMMU test answers are public; inspect the Pro release separately. The project leaderboard is dated September 2025. Keep standard and vision-only settings separate.
Evaluation groups
Open a group to see its exact protocol and scores. Different configurations remain separate.
Model rankings
Open a group to compare scores within its reported protocol. Positions do not establish statistical significance.
Scope · Multimodal expert reasoning evaluation; observed 2026-10-19; result date not supplied
Other reported results
These reports have no model ranking. Open a group for its evidence and the reason positions are withheld.
- Muse Glimmer 30BVersion not reported
MMMU_Pro · mmmu pro standard 10 options · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-08-10
Scope · Registered model evaluation · Muse Glimmer-30B model card
- Inkling SmallVersion not reported
MMMU_Pro · mmmu pro standard 10 options · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-07-31
Scope · Registered model evaluation · Model Card
- InklingVersion not reported
MMMU_Pro · mmmu pro standard 10 options · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-07-19
Scope · Registered model evaluation · Model Card
- MiniMax M3Version not reported
MMMU_Pro · mmmu pro standard 10 options · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-06-23
Scope · Registered model evaluation · MiniMax-M3 model card
- MMMU_Pro · mmmu pro visionVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2026-05-15
Scope · Registered model evaluation · Model Card
- MMMU_Pro · mmmu pro visionVersion not reported
Hugging Face eval result
2 models with scores · Positions withheld
Measurement date 2026-05-12
Scope · Registered model evaluation · Model Card
- MMMU_Pro · mmmu pro visionVersion not reported
Hugging Face eval result
3 models with scores · Positions withheld
Measurement date 2026-04-28
Scope · Registered model evaluation · Model Card
- Kimi K2.5Version not reported
MMMU_Pro · mmmu pro vision · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-23
Scope · Registered model evaluation · Model Card
- Kimi K2.6Version not reported
MMMU_Pro · mmmu pro vision · Hugging Face eval result
Single-model result · Positions withheld
Measurement date 2026-04-20
Scope · Registered model evaluation · Model Card