Skip to main content

Claude Opus 4.5vs.Qwen 3.8 27B

Which one is better?

Level in the overall index: the gap is too small for a clear winner. Qwen 3.8 27B is cheaper: Claude Opus 4.5 costs 125 times (input) and 10 times (output) as much per token.

IntelligenceOverall index, 0 to 100 · higher is better
3

Claude Opus 4.5

Rank 54 to 68

11

Qwen 3.8 27B

Rank 44 to 57

SpeedTokens per second · higher is better
56

Claude Opus 4.5

slow

40

Qwen 3.8 27B

slow

PriceDollars per 1M tokens · lower is better
$10

Claude Opus 4.5

expensive

$0.66

Qwen 3.8 27B

fairly cheap

Claude Opus 4.5

Subscription

No Anthropic subscription includes this model. Through other providers from €6.83 a month (Poe Basic, with limited points). 39 plans in Germany.

Via API

$5 input, $25 output per 1M tokens, unchanged since our price tracking began on Aug 14, 2026.

Note
There is a successor: Claude Opus 4.6 (rank 43 to 60, same price).

Qwen 3.8 27B

Subscription

No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.

Via API

$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.

Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT

Where is the difference?

Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.

Opus 4.5 ahead: 1Qwen 3.8 27B ahead: 3level: 3too little data: 2of 9 areas

Opus 4.5Qwen 3.8 27B0 to 100, higher is better
Areas in the overall index
CodingQwen 3.8 27B aheadOpus 4.5: 2Qwen 3.8 27B: 13
Reasoningtoo little dataOpus 4.5: 2Qwen 3.8 27B: 6
MathematicsOpus 4.5 aheadOpus 4.5: 13Qwen 3.8 27B: 8
Knowledgetoo little dataOpus 4.5: 5Qwen 3.8 27B: 5
AgentslevelOpus 4.5: 2Qwen 3.8 27B: 21
MultimodalQwen 3.8 27B aheadOpus 4.5: 3Qwen 3.8 27B: 13
Specialist fields
FinancelevelOpus 4.5: 8Qwen 3.8 27B: 34
LegalQwen 3.8 27B aheadOpus 4.5: 5Qwen 3.8 27B: 23
HealthlevelOpus 4.5: 7Qwen 3.8 27B: 3
Show 2 more areas that do not count toward the overall index
Opus 4.5Qwen 3.8 27B0 to 100, higher is better
Cybersecurityonly Qwen 3.8 27B has a scoreOpus 4.5: not enough dataQwen 3.8 27B: 19
Productivityonly Opus 4.5 has a scoreOpus 4.5: 4Qwen 3.8 27B: not enough data

See for yourself: same task, one attempt

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

A community classic for free-form SVG drawing.

Claude Opus 4.5

Claude Opus 4.5: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (requested): high

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
anthropic/claude-opus-4.5
API model reported in response
anthropic/claude-opus-4.5
Reasoning setting
high
Pinned endpoint
Anthropic | anthropic/claude-4.5-opus-20251124
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
21.6 s

Visually reviewed. This individual test does not establish overall model quality.

Qwen 3.8 27B

Not tested yet

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Shared test round: 43b8c5c46830

Claude Opus 4.5

Unavailable in this round

Qwen 3.8 27B

Qwen 3.8 27B: SVG short test
Test run: Oct 14, 2026 · alibaba
Test detailsAPI reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokens

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricClaude Opus 4.5Qwen 3.8 27B
Intelligence
Overall index0 to 100, higher is better311
RankRank 54 to 68 of 95Rank 44 to 57 of 95
Price per 1M tokens
Inputwhat you send$5$0.04
Outputwhat the model writes$25$2.50
Speed
Tokens per second5640
Technical
Context windowhow much text the model reads at once200,000 tokens≈ 300 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffMay 2025n/a
ReleasedNovember 2025Aug 14, 2026
AvailabilityActiveActive
Open weightsnoyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: Claude Opus 4.5B: Qwen 3.8 27B

CritPt v2Overall · higher is betterClaude Opus 4.5: 0.3%Qwen 3.8 27B: 0.3%Artificial AnalysisAs of 10/29/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 79.5%Qwen 3.8 27B: 88.9%Vals AIAs of 09/01/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 82.8%Qwen 3.8 27B: 82.4%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 75%Qwen 3.8 27B: 84%Vals AIAs of 09/01/2026
MedCodeOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 45.2%Qwen 3.8 27B: 28.7%Vals AIAs of 10/13/2026
MedScribeOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 83.2%Qwen 3.8 27B: 83.8%Vals AIAs of 10/13/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 85.6%Qwen 3.8 27B: 84.3%Vals AIAs of 09/01/2026
MMMU ProOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 81.1%Qwen 3.8 27B: 83.9%Vals AIAs of 09/01/2026
MMMU-ProOverall · higher is betterClaude Opus 4.5: 71.2%Qwen 3.8 27B: 69.9%Artificial AnalysisAs of 10/29/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 68.7%Qwen 3.8 27B: 64.9%Vals AIAs of 09/01/2026
Show 29 more benchmarks
TaxEval v2Overall · higher is betterTest setup not documented as identicalClaude Opus 4.5: 74.3%Qwen 3.8 27B: 70.9%Vals AIAs of 09/01/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalClaude Opus 4.5: 79.3%Qwen 3.8 27B: 88.9%Vals AIAs of 09/01/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalClaude Opus 4.5: 87.7%Qwen 3.8 27B: 88.4%Vals AIAs of 10/13/2026
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalClaude Opus 4.5: 99.1%Qwen 3.8 27B: 99.1%Vals AIAs of 09/01/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalClaude Opus 4.5: 94%Qwen 3.8 27B: 91.5%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalClaude Opus 4.5: 77.4%Qwen 3.8 27B: 69.4%Vals AIAs of 09/01/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalClaude Opus 4.5: 63.1%Qwen 3.8 27B: 60.1%Vals AIAs of 09/01/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalClaude Opus 4.5: 79.8%Qwen 3.8 27B: 88.9%Vals AIAs of 09/01/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalClaude Opus 4.5: 82.2%Qwen 3.8 27B: 82%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalClaude Opus 4.5: 44.6%Qwen 3.8 27B: 65.7%Vals AIAs of 09/01/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalClaude Opus 4.5: 80.9%Qwen 3.8 27B: 90.2%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalClaude Opus 4.5: 59.9%Qwen 3.8 27B: 60.5%Vals AIAs of 09/01/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalClaude Opus 4.5: 85.5%Qwen 3.8 27B: 81.6%Vals AIAs of 09/01/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalClaude Opus 4.5: 84.2%Qwen 3.8 27B: 90.2%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalClaude Opus 4.5: 81.5%Qwen 3.8 27B: 87.2%Vals AIAs of 09/01/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalClaude Opus 4.5: 89.5%Qwen 3.8 27B: 91.8%Vals AIAs of 09/01/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalClaude Opus 4.5: 79.8%Qwen 3.8 27B: 81.4%Vals AIAs of 10/13/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalClaude Opus 4.5: 84.1%Qwen 3.8 27B: 88.3%Vals AIAs of 09/01/2026
LegalBenchRule Tasks · higher is betterTest setup not documented as identicalClaude Opus 4.5: 80.3%Qwen 3.8 27B: 70.2%Vals AIAs of 10/13/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalClaude Opus 4.5: 89.6%Qwen 3.8 27B: 88.2%Vals AIAs of 09/01/2026
MMLU ProEngineering · higher is betterTest setup not documented as identicalClaude Opus 4.5: 76.2%Qwen 3.8 27B: 82.4%Vals AIAs of 09/01/2026
MMLU ProHealth · higher is betterTest setup not documented as identicalClaude Opus 4.5: 84%Qwen 3.8 27B: 78.6%Vals AIAs of 09/01/2026
MMLU ProHistory · higher is betterTest setup not documented as identicalClaude Opus 4.5: 78.5%Qwen 3.8 27B: 75.6%Vals AIAs of 09/01/2026
MMLU ProLaw · higher is betterTest setup not documented as identicalClaude Opus 4.5: 78.3%Qwen 3.8 27B: 67.8%Vals AIAs of 09/01/2026
MMLU ProMath · higher is betterTest setup not documented as identicalClaude Opus 4.5: 92.3%Qwen 3.8 27B: 94.8%Vals AIAs of 09/01/2026
MMLU ProOthers · higher is betterTest setup not documented as identicalClaude Opus 4.5: 84.6%Qwen 3.8 27B: 76.8%Vals AIAs of 09/01/2026
MMLU ProPhilosophy · higher is betterTest setup not documented as identicalClaude Opus 4.5: 87.8%Qwen 3.8 27B: 78.6%Vals AIAs of 09/01/2026
MMLU ProPhysics · higher is betterTest setup not documented as identicalClaude Opus 4.5: 89.8%Qwen 3.8 27B: 91.3%Vals AIAs of 09/01/2026
MMLU ProPsychology · higher is betterTest setup not documented as identicalClaude Opus 4.5: 88.7%Qwen 3.8 27B: 84.8%Vals AIAs of 09/01/2026

Compare another matchup