Skip to main content

Claude Haiku 4.5vs.Qwen 3.8 27B

Which one is better?

Only Qwen 3.8 27B has a place in the overall index so far; Claude Haiku 4.5 does not have enough benchmark results yet. Qwen 3.8 27B is cheaper: Claude Haiku 4.5 costs 25 times (input) and 2 times (output) as much per token.

IntelligenceOverall index, 0 to 100 · higher is better
n/a

Claude Haiku 4.5

not ranked yet

11

Qwen 3.8 27B

Rank 44 to 57

SpeedTokens per second · higher is better
86

Claude Haiku 4.5

fairly slow

40

Qwen 3.8 27B

slow

PriceDollars per 1M tokens · lower is better
$2

Claude Haiku 4.5

fairly expensive

$0.66

Qwen 3.8 27B

fairly cheap

Claude Haiku 4.5

Subscription

At Anthropic from €21.42 a month (Claude Pro). Through other providers from ≈ €6.36 a month (ElevenLabs Starter, with limited credits). 64 plans in Germany.

Via API

$1 input, $5 output per 1M tokens, cheaper since Aug 22, 2026 (before $1.10 and $5.50).

Note
There is a successor: Claude Haiku 5.5 (rank 16 to 27, $0.10 input, $0.50 output).

Qwen 3.8 27B

Subscription

No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.

Via API

$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.

Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT

Where is the difference?

Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.

Haiku 4.5 ahead: 0Qwen 3.8 27B ahead: 2level: 0too little data: 7of 9 areas

Haiku 4.5Qwen 3.8 27B0 to 100, higher is better
Areas in the overall index
Codingonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 13
Reasoningonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 6
Mathematicsonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 8
Knowledgeonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 5
AgentsQwen 3.8 27B aheadHaiku 4.5: 2Qwen 3.8 27B: 21
Multimodalonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 13
Specialist fields
FinanceQwen 3.8 27B aheadHaiku 4.5: 1Qwen 3.8 27B: 34
Legalonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 23
Healthonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 3
Show 2 more areas that do not count toward the overall index
Haiku 4.5Qwen 3.8 27B0 to 100, higher is better
Cybersecurityonly Qwen 3.8 27B has a scoreHaiku 4.5: not enough dataQwen 3.8 27B: 19
Productivityonly Haiku 4.5 has a scoreHaiku 4.5: 1Qwen 3.8 27B: not enough data

See for yourself: same task, one attempt

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Shared test round: 43b8c5c46830

Claude Haiku 4.5

Claude Haiku 4.5: SVG short test
Test run: Oct 14, 2026 · anthropic
Test detailsAPI reports 0 reasoning tokensAPI model: anthropic/claude-haiku-4.5848 output tokens

Qwen 3.8 27B

Qwen 3.8 27B: SVG short test
Test run: Oct 14, 2026 · alibaba
Test detailsAPI reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokens
Earlier tests

Pelican on a bicycle

A community classic for free-form SVG drawing.

Claude Haiku 4.5

Claude Haiku 4.5: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (requested): high

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
anthropic/claude-haiku-4.5
API model reported in response
anthropic/claude-haiku-4.5
Reasoning setting
high
Pinned endpoint
Anthropic | anthropic/claude-4.5-haiku-20251001
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
10.1 s

Visually reviewed. This individual test does not establish overall model quality.

Qwen 3.8 27B

Not tested yet

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricClaude Haiku 4.5Qwen 3.8 27B
Intelligence
Overall index0 to 100, higher is bettern/a11
Ranknot ranked yetRank 44 to 57 of 95
Price per 1M tokens
Inputwhat you send$1$0.04
Outputwhat the model writes$5$2.50
Speed
Tokens per second8640
Technical
Context windowhow much text the model reads at once200,000 tokens≈ 300 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffFebruary 2025n/a
ReleasedOctober 2025Aug 14, 2026
AvailabilityActiveActive
Open weightsnoyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: Claude Haiku 4.5B: Qwen 3.8 27B

CritPt v2Overall · higher is betterClaude Haiku 4.5: 0.0%Qwen 3.8 27B: 0.3%Artificial AnalysisAs of 10/29/2026
MMMU-ProOverall · higher is betterClaude Haiku 4.5: 55.1%Qwen 3.8 27B: 69.9%Artificial AnalysisAs of 10/29/2026

Compare another matchup