- Source value
- 16.25
- Score
- 16.25
- Metric
- pass^5 reliability
- Unit
- %
- Benchmark version
- AA cohort: 80 questions
- Category
- agentic
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Ling-3.0-flash-Fin (release ling-3-0-flash-fin, row ling-3-0-flash-fin, UUID 6d6fa1c9-b833-40b2-8a58-fa810e24a84e, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap.
80 quantitative questions across 14 domains are run five independent times. pass^5 counts only questions answered correctly in all five attempts.. Source model ID: artificial-analysis/6d6fa1c9-b833-40b2-8a58-fa810e24a84e/ling-3-0-flash-fin/ling-3-0-flash-fin. Source model name: Ling-3.0-flash-Fin. Provider reported by source: InclusionAI. Model snapshot: Ling-3.0-flash-Fin. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup analyst agent. Tool policy: 100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission. Attempts: pass^5, 5 independent attempts per question. Reasoning: reasoning enabled. Score display: 16.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-aa-analyst-agent:AA cohort: 80 questions:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Ling-3.0-flash-Fin (release ling-3-0-flash-fin, row ling-3-0-flash-fin, UUID 6d6fa1c9-b833-40b2-8a58-fa810e24a84e, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap.
80 quantitative questions across 14 domains are run five independent times. pass^5 counts only questions answered correctly in all five attempts.. Harness: Artificial Analysis Stirrup. Agent: Stirrup analyst agent. Tool policy: 100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission. Attempts: pass^5, 5 independent attempts per question. Reasoning: reasoning enabled
- Context
- Questions, source files, and reference answers are private. pass^5 measures reliability across all five attempts, not pass@1.. This result is retained as historical evidence and is not interchangeable with current results.