Model results

MMMU-Pro

Choose a shared evaluation protocol to compare model scores. Versions, sources and configurations stay separate.

Atlas snapshot captured 10/19/2026, 10:20:28 AM UTC. This is an import timestamp, not the evaluation date. Coverage may be incomplete.

Reviewed recommendation and limits

Prefer Pro to original MMMU when testing whether a model actually needs to understand the image.

MMMU-Pro standard and vision-only settings remain separate. Imported groups below may use different protocols; this review does not certify each run. Original MMMU test answers are public; inspect the Pro release separately. The project leaderboard is dated September 2025. Keep standard and vision-only settings separate.

Publisher results MMMU-Pro paper

← All evaluation groups

MMMU_Pro · mmmu pro vision

Source: Hugging Face eval result
Version: Not reported
Measurement date: 2026-04-28
Metric: % · Higher is better
Evaluation scope: Registered model evaluation · Model Card

Positions are withheld because at least one result lacks explicit independent provenance or a documented evaluation scope. Missing metadata is shown as unreported; matching imported metadata is not independent verification of the protocol.

Qwen3.5-35B-A3B
qwen/qwen3.5-35b-a3b-20260224
75.1%
View modelEvidence Evidence class unreported
Qwen3.5-27B
qwen/qwen3.5-27b-20260224
75%
View modelEvidence Evidence class unreported
Qwen3.5-9B
qwen/qwen3.5-9b-20260310
70.1%
View modelEvidence Evidence class unreported