Skip to main content

Qwen 3.8 27Bvs.MiMo-V2.5-Pro

Which one is better?

Qwen 3.8 27B is clearly ahead in the overall index. Qwen 3.8 27B is cheaper for input, MiMo-V2.5-Pro for output.

IntelligenceOverall index, 0 to 100 · higher is better
11

Qwen 3.8 27B

Rank 44 to 57

3

MiMo-V2.5-Pro

Rank 55 to 69

SpeedTokens per second · higher is better
40

Qwen 3.8 27B

slow

51

MiMo-V2.5-Pro

slow

PriceDollars per 1M tokens · lower is better
$0.66

Qwen 3.8 27B

fairly cheap

$0.54

MiMo-V2.5-Pro

fairly cheap

Qwen 3.8 27B

Subscription

No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.

Via API

$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.

MiMo-V2.5-Pro

Subscription

No Xiaomi subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.

Via API

$0.435 input, $0.87 output per 1M tokens according to the provider; the price index has listed it at $0.48 and $1.80 since Oct 26, 2026.

Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT

Where is the difference?

Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.

Qwen 3.8 27B ahead: 3MiMo-V2.5-Pro ahead: 0level: 2too little data: 5of 10 areas

Qwen 3.8 27BMiMo-V2.5-Pro0 to 100, higher is better
Areas in the overall index
CodinglevelQwen 3.8 27B: 13MiMo-V2.5-Pro: 4
Reasoningtoo little dataQwen 3.8 27B: 6MiMo-V2.5-Pro: 3
Mathematicstoo little dataQwen 3.8 27B: 8MiMo-V2.5-Pro: 6
Knowledgetoo little dataQwen 3.8 27B: 5MiMo-V2.5-Pro: 3
AgentsQwen 3.8 27B aheadQwen 3.8 27B: 21MiMo-V2.5-Pro: 1
Generalonly MiMo-V2.5-Pro has a scoreQwen 3.8 27B: not enough dataMiMo-V2.5-Pro: 11
Multimodalonly Qwen 3.8 27B has a scoreQwen 3.8 27B: 13MiMo-V2.5-Pro: not enough data
Specialist fields
FinanceQwen 3.8 27B aheadQwen 3.8 27B: 34MiMo-V2.5-Pro: 8
LegalQwen 3.8 27B aheadQwen 3.8 27B: 23MiMo-V2.5-Pro: 2
HealthlevelQwen 3.8 27B: 3MiMo-V2.5-Pro: 3
Show 1 more areas that do not count toward the overall index
Qwen 3.8 27BMiMo-V2.5-Pro0 to 100, higher is better
Cybersecurityonly Qwen 3.8 27B has a scoreQwen 3.8 27B: 19MiMo-V2.5-Pro: not enough data

See for yourself: same task, one attempt

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Shared test round: 43b8c5c46830

Qwen 3.8 27B

Qwen 3.8 27B: SVG short test
Test run: Oct 14, 2026 · alibaba
Test detailsAPI reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokens

MiMo-V2.5-Pro

MiMo-V2.5-Pro: SVG short test
Test run: Oct 14, 2026 · xiaomi/fp8
Test detailsAPI reports 0 reasoning tokensAPI model: xiaomi/mimo-v2.5-pro1,261 output tokens
Earlier tests

Pelican on a bicycle

A community classic for free-form SVG drawing.

Qwen 3.8 27B

Not tested yet

MiMo-V2.5-Pro

MiMo-V2.5-Pro: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (requested): high

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
xiaomi/mimo-v2.5-pro
API model reported in response
xiaomi/mimo-v2.5-pro
Reasoning setting
high
Pinned endpoint
Xiaomi | xiaomi/mimo-v2.5-pro-20260422
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
110.7 s

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)
  • Sep 7, 2026API request failedReasoning setting: high
Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricQwen 3.8 27BMiMo-V2.5-Pro
Intelligence
Overall index0 to 100, higher is better113
RankRank 44 to 57 of 95Rank 55 to 69 of 95
Price per 1M tokens
Inputwhat you send$0.04$0.435
Outputwhat the model writes$2.50$0.87
Speed
Tokens per second4051
Technical
Context windowhow much text the model reads at once262,144 tokens≈ 390 A4 pages1 M tokens≈ 1,500 A4 pages
Knowledge cutoffn/an/a
ReleasedAug 14, 2026Apr 27, 2026
AvailabilityActiveOpen Source
Open weightsyesyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: Qwen 3.8 27BB: MiMo-V2.5-Pro

Code MigrationOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 14.2%MiMo-V2.5-Pro: 21.6%Vals AIAs of 10/18/2026
CritPt v2Overall · higher is betterQwen 3.8 27B: 0.3%MiMo-V2.5-Pro: 1.1%Artificial AnalysisAs of 10/29/2026
EMBOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 59.7%MiMo-V2.5-Pro: 55.2%Vals AIAs of 10/20/2026
Finance Agent (v2)Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 48.6%MiMo-V2.5-Pro: 41.5%Vals AIAs of 10/20/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%MiMo-V2.5-Pro: 82.6%Vals AIAs of 09/01/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 36.1%MiMo-V2.5-Pro: 15.9%Vals AIAs of 10/26/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 82.4%MiMo-V2.5-Pro: 77.1%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 84%MiMo-V2.5-Pro: 81.4%Vals AIAs of 09/01/2026
MedCodeOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 28.7%MiMo-V2.5-Pro: 32.5%Vals AIAs of 10/13/2026
MedScribeOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 83.8%MiMo-V2.5-Pro: 83.7%Vals AIAs of 10/13/2026
Show 54 more benchmarks
MMLU ProOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 84.3%MiMo-V2.5-Pro: 84.6%Vals AIAs of 09/01/2026
ProofBench v1.1Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 16%MiMo-V2.5-Pro: 22%Vals AIAs of 10/24/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 86%MiMo-V2.5-Pro: 74%Vals AIAs of 09/01/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 30.9%MiMo-V2.5-Pro: 11.5%Vals AIAs of 10/26/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.9%MiMo-V2.5-Pro: 73.8%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 58.4%MiMo-V2.5-Pro: 57.3%Vals AIAs of 10/01/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 64.9%MiMo-V2.5-Pro: 34.1%Vals AIAs of 10/26/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalQwen 3.8 27B: 2.2%MiMo-V2.5-Pro: 14%Vals AIAs of 10/18/2026
EMBComps · higher is betterTest setup not documented as identicalQwen 3.8 27B: 53.3%MiMo-V2.5-Pro: 47.3%Vals AIAs of 10/20/2026
Finance Agent (v2)Adjustments · higher is betterTest setup not documented as identicalQwen 3.8 27B: 47.3%MiMo-V2.5-Pro: 34.4%Vals AIAs of 10/20/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%MiMo-V2.5-Pro: 80.8%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 45.5%MiMo-V2.5-Pro: 18.2%Vals AIAs of 10/26/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.4%MiMo-V2.5-Pro: 88%Vals AIAs of 10/13/2026
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalQwen 3.8 27B: 99.1%MiMo-V2.5-Pro: 99.1%Vals AIAs of 09/01/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.5%MiMo-V2.5-Pro: 92.5%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%MiMo-V2.5-Pro: 82.5%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 6.7%MiMo-V2.5-Pro: 3.3%Vals AIAs of 10/26/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.1%MiMo-V2.5-Pro: 63.1%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Easy · higher is betterTest setup not documented as identicalQwen 3.8 27B: 50%MiMo-V2.5-Pro: 75%Vals AIAs of 10/01/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalQwen 3.8 27B: 50%MiMo-V2.5-Pro: 44.3%Vals AIAs of 10/18/2026
EMBDataroom · higher is betterTest setup not documented as identicalQwen 3.8 27B: 79.7%MiMo-V2.5-Pro: 78%Vals AIAs of 10/20/2026
Finance Agent (v2)All-Pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 36.8%MiMo-V2.5-Pro: 28.8%Vals AIAs of 10/20/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%MiMo-V2.5-Pro: 84.3%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.5%MiMo-V2.5-Pro: 77.1%Vals AIAs of 10/26/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 82%MiMo-V2.5-Pro: 79.5%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalQwen 3.8 27B: 65.7%MiMo-V2.5-Pro: 58.6%Vals AIAs of 09/01/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%MiMo-V2.5-Pro: 90%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalQwen 3.8 27B: 66.7%MiMo-V2.5-Pro: 33.3%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 48.3%MiMo-V2.5-Pro: 32.7%Vals AIAs of 10/26/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalQwen 3.8 27B: 81.6%MiMo-V2.5-Pro: 84.5%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Hard · higher is betterTest setup not documented as identicalQwen 3.8 27B: 43.3%MiMo-V2.5-Pro: 40%Vals AIAs of 10/01/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalQwen 3.8 27B: 4.197 / 5MiMo-V2.5-Pro: 3.382 / 5Vals AIAs of 10/18/2026
EMBDCF · higher is betterTest setup not documented as identicalQwen 3.8 27B: 50%MiMo-V2.5-Pro: 43.6%Vals AIAs of 10/20/2026
Finance Agent (v2)Comparables · higher is betterTest setup not documented as identicalQwen 3.8 27B: 38.9%MiMo-V2.5-Pro: 40.2%Vals AIAs of 10/20/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 41.9%MiMo-V2.5-Pro: 11.6%Vals AIAs of 10/26/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%MiMo-V2.5-Pro: 80.2%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalQwen 3.8 27B: 87.2%MiMo-V2.5-Pro: 86.4%Vals AIAs of 09/01/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.8%MiMo-V2.5-Pro: 90.5%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalQwen 3.8 27B: 69%MiMo-V2.5-Pro: 33.3%Vals AIAs of 09/01/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 43.1%MiMo-V2.5-Pro: 15%Vals AIAs of 10/26/2026
Terminal-Bench 2.1Medium · higher is betterTest setup not documented as identicalQwen 3.8 27B: 67.3%MiMo-V2.5-Pro: 65.5%Vals AIAs of 10/01/2026
EMBLBO · higher is betterTest setup not documented as identicalQwen 3.8 27B: 53.7%MiMo-V2.5-Pro: 47.7%Vals AIAs of 10/20/2026
Finance Agent (v2)Disclosure Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.3%MiMo-V2.5-Pro: 53.1%Vals AIAs of 10/20/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit · higher is betterTest setup not documented as identicalQwen 3.8 27B: 86.8%MiMo-V2.5-Pro: 81.1%Vals AIAs of 10/26/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 81.4%MiMo-V2.5-Pro: 65%Vals AIAs of 10/13/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.3%MiMo-V2.5-Pro: 88%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalQwen 3.8 27B: 85.8%MiMo-V2.5-Pro: 74.7%Vals AIAs of 09/01/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 58.6%MiMo-V2.5-Pro: 42.2%Vals AIAs of 10/26/2026
EMBM&A · higher is betterTest setup not documented as identicalQwen 3.8 27B: 64.8%MiMo-V2.5-Pro: 64.1%Vals AIAs of 10/20/2026
Finance Agent (v2)Earnings Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.9%MiMo-V2.5-Pro: 54.6%Vals AIAs of 10/20/2026
Legal Research BenchCivil Litigation · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 25.9%MiMo-V2.5-Pro: 11.1%Vals AIAs of 10/26/2026
LegalBenchRule Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.2%MiMo-V2.5-Pro: 73%Vals AIAs of 10/13/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.2%MiMo-V2.5-Pro: 87.9%Vals AIAs of 09/01/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 34.9%MiMo-V2.5-Pro: 10.5%Vals AIAs of 10/26/2026

Compare another matchup