- Source value
- 78.9595375722543
- Score
- 78.9595375722543
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- AA cohort: 1,730 questions
- Category
- multimodal
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Ling-3.0-flash-VL (release ling-3-0-flash-vl, row ling-3-0-flash-vl, UUID 433d5c5d-3092-4026-9727-1587ca07915d, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap.
The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/433d5c5d-3092-4026-9727-1587ca07915d/ling-3-0-flash-vl/ling-3-0-flash-vl. Source model name: Ling-3.0-flash-VL. Provider reported by source: InclusionAI. Model snapshot: Ling-3.0-flash-VL. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled. Score display: 79.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Ling-3.0-flash-VL (release ling-3-0-flash-vl, row ling-3-0-flash-vl, UUID 433d5c5d-3092-4026-9727-1587ca07915d, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap.
The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled
- Context
- The benchmark page describes 3,460 questions in the full MMMU-Pro dataset; AA's methodology specifies a 1,730-question run.. This result is retained as historical evidence and is not interchangeable with current results.