Skip to main content

Claude Sonnet 4.5vs.Qwen 3.8 27B

Which one is better?

Qwen 3.8 27B is clearly ahead in the overall index and is cheaper too: Claude Sonnet 4.5 costs 75 times (input) and 6 times (output) as much per token.

IntelligenceOverall index, 0 to 100 · higher is better
below 1

Claude Sonnet 4.5

Rank 62 to 76

11

Qwen 3.8 27B

Rank 44 to 57

SpeedTokens per second · higher is better
48

Claude Sonnet 4.5

slow

40

Qwen 3.8 27B

slow

PriceDollars per 1M tokens · lower is better
$6

Claude Sonnet 4.5

expensive

$0.66

Qwen 3.8 27B

fairly cheap

Claude Sonnet 4.5

Subscription

No Anthropic subscription includes this model. Through other providers from ≈ €6.36 a month (ElevenLabs Starter, with limited credits). 44 plans in Germany.

Via API

$3 input, $15 output per 1M tokens, unchanged since our price tracking began on Aug 14, 2026.

Note
There is a successor: Claude Sonnet 4.6 (rank 43 to 54, same price).

Qwen 3.8 27B

Subscription

No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.

Via API

$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.

Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT

Where is the difference?

Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.

Sonnet 4.5 ahead: 0Qwen 3.8 27B ahead: 4level: 1too little data: 4of 9 areas

Sonnet 4.5Qwen 3.8 27B0 to 100, higher is better
Areas in the overall index
CodingQwen 3.8 27B aheadSonnet 4.5: below 1Qwen 3.8 27B: 13
Reasoningonly Qwen 3.8 27B has a scoreSonnet 4.5: not enough dataQwen 3.8 27B: 6
Mathematicsonly Qwen 3.8 27B has a scoreSonnet 4.5: not enough dataQwen 3.8 27B: 8
Knowledgeonly Qwen 3.8 27B has a scoreSonnet 4.5: not enough dataQwen 3.8 27B: 5
AgentsQwen 3.8 27B aheadSonnet 4.5: 2Qwen 3.8 27B: 21
Multimodalonly Qwen 3.8 27B has a scoreSonnet 4.5: not enough dataQwen 3.8 27B: 13
Specialist fields
FinanceQwen 3.8 27B aheadSonnet 4.5: 2Qwen 3.8 27B: 34
LegalQwen 3.8 27B aheadSonnet 4.5: below 1Qwen 3.8 27B: 23
HealthlevelSonnet 4.5: 7Qwen 3.8 27B: 3
Show 2 more areas that do not count toward the overall index
Sonnet 4.5Qwen 3.8 27B0 to 100, higher is better
Cybersecurityonly Qwen 3.8 27B has a scoreSonnet 4.5: not enough dataQwen 3.8 27B: 19
Productivityonly Sonnet 4.5 has a scoreSonnet 4.5: 1Qwen 3.8 27B: not enough data

See for yourself: same task, one attempt

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Shared test round: 43b8c5c46830

Claude Sonnet 4.5

Claude Sonnet 4.5: SVG short test
Test run: Oct 14, 2026 · anthropic
Test detailsAPI reports 0 reasoning tokensAPI model: anthropic/claude-sonnet-4.5686 output tokens

Qwen 3.8 27B

Qwen 3.8 27B: SVG short test
Test run: Oct 14, 2026 · alibaba
Test detailsAPI reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokens
Earlier tests

Pelican on a bicycle

A community classic for free-form SVG drawing.

Claude Sonnet 4.5

Claude Sonnet 4.5: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (requested): high

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
anthropic/claude-sonnet-4.5
API model reported in response
anthropic/claude-sonnet-4.5
Reasoning setting
high
Pinned endpoint
Anthropic | anthropic/claude-4.5-sonnet-20250929
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
30.2 s

Visually reviewed. This individual test does not establish overall model quality.

Qwen 3.8 27B

Not tested yet

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricClaude Sonnet 4.5Qwen 3.8 27B
Intelligence
Overall index0 to 100, higher is betterbelow 111
RankRank 62 to 76 of 95Rank 44 to 57 of 95
Price per 1M tokens
Inputwhat you send$3$0.04
Outputwhat the model writes$15$2.50
Speed
Tokens per second4840
Technical
Context windowhow much text the model reads at once200,000 tokens≈ 300 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffJanuary 2025n/a
ReleasedSeptember 2025Aug 14, 2026
AvailabilityActiveActive
Open weightsnoyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: Claude Sonnet 4.5B: Qwen 3.8 27B

CritPt v2Overall · higher is betterClaude Sonnet 4.5: 0.0%Qwen 3.8 27B: 0.3%Artificial AnalysisAs of 10/29/2026
MedCodeOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.5: 40.6%Qwen 3.8 27B: 28.7%Vals AIAs of 10/13/2026
MedScribeOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.5: 84.5%Qwen 3.8 27B: 83.8%Vals AIAs of 10/13/2026
MMMU-ProOverall · higher is betterClaude Sonnet 4.5: 65.2%Qwen 3.8 27B: 69.9%Artificial AnalysisAs of 10/29/2026

Compare another matchup