Claude Sonnet 4.6vs.Qwen 3.8 27B
Which one is better?
Level in the overall index: the gap is too small for a clear winner. Qwen 3.8 27B is cheaper: Claude Sonnet 4.6 costs 75 times (input) and 6 times (output) as much per token.
15
Claude Sonnet 4.6
Rank 43 to 54
11
Qwen 3.8 27B
Rank 44 to 57
65
Claude Sonnet 4.6
slow
40
Qwen 3.8 27B
slow
$6
Claude Sonnet 4.6
expensive
$0.66
Qwen 3.8 27B
fairly cheap
Claude Sonnet 4.6
- Subscription
At Anthropic from €21.42 a month (Claude Pro). Through other providers from ≈ €6.36 a month (ElevenLabs Starter, with limited credits). 56 plans in Germany.
- Via API
$3 input, $15 output per 1M tokens, unchanged since our price tracking began on Aug 14, 2026.
- Note
- There is a successor: Claude Sonnet 5 (rank 35 to 43, $2 input, $10 output).
Qwen 3.8 27B
- Subscription
No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.
- Via API
$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.
Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT
Where is the difference?
Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.
Sonnet 4.6 ahead: 1Qwen 3.8 27B ahead: 0level: 6too little data: 3of 10 areas
AreaSonnet 4.6Qwen 3.8 27B0 to 100, higher is betterResult
Areas in the overall index
CodinglevelSonnet 4.6: 16Qwen 3.8 27B: 13
ReasoninglevelSonnet 4.6: 7Qwen 3.8 27B: 6
Mathematicsonly Qwen 3.8 27B has a scoreSonnet 4.6: not enough dataQwen 3.8 27B: 8
KnowledgeSonnet 4.6 aheadSonnet 4.6: 18Qwen 3.8 27B: 5
AgentslevelSonnet 4.6: 18Qwen 3.8 27B: 21
Generalonly Sonnet 4.6 has a scoreSonnet 4.6: 9Qwen 3.8 27B: not enough data
MultimodallevelSonnet 4.6: 21Qwen 3.8 27B: 13
Specialist fields
FinancelevelSonnet 4.6: 38Qwen 3.8 27B: 34
LegallevelSonnet 4.6: 27Qwen 3.8 27B: 23
Healthtoo little dataSonnet 4.6: 3Qwen 3.8 27B: 3
Show 2 more areas that do not count toward the overall index
AreaSonnet 4.6Qwen 3.8 27B0 to 100, higher is betterResult
Cybersecurityonly Qwen 3.8 27B has a scoreSonnet 4.6: not enough dataQwen 3.8 27B: 19
Productivityonly Sonnet 4.6 has a scoreSonnet 4.6: 24Qwen 3.8 27B: not enough data
See for yourself: same task, one attempt
SVG short test
One SVG task with the same fixed settings for every model, without hidden thinking.
Shared test round: 43b8c5c46830
Claude Sonnet 4.6
Test details
API reports 0 reasoning tokensAPI model: anthropic/claude-sonnet-4.6738 output tokensQwen 3.8 27B
Test details
API reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokensEarlier tests
Pelican on a bicycle
A community classic for free-form SVG drawing.
Claude Sonnet 4.6
The response reached the token limit. No complete recording is available.
Reasoning (requested): high
Current attempt
- Run date
- Oct 6, 2026
- API provider
- openrouter
- Requested API model
- anthropic/claude-sonnet-4.6
- API model reported in response
- anthropic/claude-sonnet-4.6
- Reasoning setting
- high
- Pinned endpoint
- Anthropic | anthropic/claude-4.6-sonnet-20260217
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Test protocol
- community-visual-tests-v1
- Technical checks
- Failed
- Response time
- 106 s
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Earlier attempts (2)
- Oct 2, 2026API request failedReasoning setting: high
- Oct 1, 2026API request failedReasoning setting: high
Qwen 3.8 27B
Not tested yet
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)All data side by side
The better value is bold. For the overall index only when the gap is clear.
| Metric | Claude Sonnet 4.6 | Qwen 3.8 27B |
|---|---|---|
| Intelligence | ||
| Overall index0 to 100, higher is better | 15 | 11 |
| Rank | Rank 43 to 54 of 95 | Rank 44 to 57 of 95 |
| Price per 1M tokens | ||
| Inputwhat you send | $3 | $0.04 |
| Outputwhat the model writes | $15 | $2.50 |
| Speed | ||
| Tokens per second | 65 | 40 |
| Technical | ||
| Context windowhow much text the model reads at once | 1 M tokens≈ 1,500 A4 pages | 262,144 tokens≈ 390 A4 pages |
| Knowledge cutoff | August 2025 | n/a |
| Released | February 2026 | Aug 14, 2026 |
| Availability | Active | Active |
| Open weights | no | yes |
Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis
Shared benchmarks
Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.
A: Claude Sonnet 4.6B: Qwen 3.8 27B
Code MigrationOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 39.9%Qwen 3.8 27B: 14.2%Vals AIAs of 10/18/2026
EMBOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 60.2%Qwen 3.8 27B: 59.7%Vals AIAs of 10/20/2026
Finance Agent (v2)Overall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 51%Qwen 3.8 27B: 48.6%Vals AIAs of 10/20/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 85.6%Qwen 3.8 27B: 88.9%Vals AIAs of 09/01/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 38.5%Qwen 3.8 27B: 36.1%Vals AIAs of 10/26/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 82.1%Qwen 3.8 27B: 82.4%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 82.1%Qwen 3.8 27B: 84%Vals AIAs of 09/01/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 87.3%Qwen 3.8 27B: 84.3%Vals AIAs of 09/01/2026
MMMU ProOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 83.6%Qwen 3.8 27B: 83.9%Vals AIAs of 09/01/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 67.7%Qwen 3.8 27B: 64.9%Vals AIAs of 09/01/2026
Show 54 more benchmarks
ProgramBenchOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 0.5%Qwen 3.8 27B: 0%Vals AIAs of 10/20/2026
SkillsBenchOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 49.1%Qwen 3.8 27B: 38.1%Vals AIAs of 09/27/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 77.4%Qwen 3.8 27B: 86%Vals AIAs of 09/01/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 25.8%Qwen 3.8 27B: 30.9%Vals AIAs of 10/26/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 77.1%Qwen 3.8 27B: 70.9%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Overall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 57.3%Qwen 3.8 27B: 58.4%Vals AIAs of 10/01/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 51.5%Qwen 3.8 27B: 64.9%Vals AIAs of 10/26/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 30.3%Qwen 3.8 27B: 2.2%Vals AIAs of 10/18/2026
EMBComps · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 61.5%Qwen 3.8 27B: 53.3%Vals AIAs of 10/20/2026
Finance Agent (v2)Adjustments · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 48.9%Qwen 3.8 27B: 47.3%Vals AIAs of 10/20/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 85.9%Qwen 3.8 27B: 88.9%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 43.9%Qwen 3.8 27B: 45.5%Vals AIAs of 10/26/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 88%Qwen 3.8 27B: 88.4%Vals AIAs of 10/13/2026
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 98.8%Qwen 3.8 27B: 99.1%Vals AIAs of 09/01/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 92.7%Qwen 3.8 27B: 91.5%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 75%Qwen 3.8 27B: 69.4%Vals AIAs of 09/01/2026
ProgramBenchAlmost Resolved · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 2%Qwen 3.8 27B: 1%Vals AIAs of 10/20/2026
SkillsBenchNo Skills · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 27.8%Qwen 3.8 27B: 19.1%Vals AIAs of 09/27/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 87.1%Qwen 3.8 27B: 90.2%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 10%Qwen 3.8 27B: 6.7%Vals AIAs of 10/26/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 65.8%Qwen 3.8 27B: 60.1%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Easy · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 100%Qwen 3.8 27B: 50%Vals AIAs of 10/01/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 68.6%Qwen 3.8 27B: 50%Vals AIAs of 10/18/2026
EMBDataroom · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 78.5%Qwen 3.8 27B: 79.7%Vals AIAs of 10/20/2026
Finance Agent (v2)All-Pass · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 38.8%Qwen 3.8 27B: 36.8%Vals AIAs of 10/20/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 85.4%Qwen 3.8 27B: 88.9%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 86.8%Qwen 3.8 27B: 88.5%Vals AIAs of 10/26/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 82.5%Qwen 3.8 27B: 82%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 60.6%Qwen 3.8 27B: 65.7%Vals AIAs of 09/01/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 91.9%Qwen 3.8 27B: 90.2%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 60.5%Qwen 3.8 27B: 60.5%Vals AIAs of 09/01/2026
ProgramBenchFully Resolved · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 0.5%Qwen 3.8 27B: 0%Vals AIAs of 10/20/2026
SkillsBenchWith Skills · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 49.1%Qwen 3.8 27B: 38.1%Vals AIAs of 09/27/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 33.3%Qwen 3.8 27B: 66.7%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 57.9%Qwen 3.8 27B: 48.3%Vals AIAs of 10/26/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 88.4%Qwen 3.8 27B: 81.6%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Hard · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 34.4%Qwen 3.8 27B: 43.3%Vals AIAs of 10/01/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 3.997 / 5Qwen 3.8 27B: 4.197 / 5Vals AIAs of 10/18/2026
EMBDCF · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 38.3%Qwen 3.8 27B: 50%Vals AIAs of 10/20/2026
Finance Agent (v2)Comparables · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 41%Qwen 3.8 27B: 38.9%Vals AIAs of 10/20/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 34.9%Qwen 3.8 27B: 41.9%Vals AIAs of 10/26/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 86.6%Qwen 3.8 27B: 90.2%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 86.9%Qwen 3.8 27B: 87.2%Vals AIAs of 09/01/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 91.9%Qwen 3.8 27B: 91.8%Vals AIAs of 09/01/2026
ProgramBenchRaw Pass Rate · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 59.1%Qwen 3.8 27B: 11.2%Vals AIAs of 10/20/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 50%Qwen 3.8 27B: 69%Vals AIAs of 09/01/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 33.2%Qwen 3.8 27B: 43.1%Vals AIAs of 10/26/2026
Terminal-Bench 2.1Medium · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 66.7%Qwen 3.8 27B: 67.3%Vals AIAs of 10/01/2026
EMBLBO · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 52.5%Qwen 3.8 27B: 53.7%Vals AIAs of 10/20/2026
Finance Agent (v2)Disclosure Analysis · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 65.8%Qwen 3.8 27B: 60.3%Vals AIAs of 10/20/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 88%Qwen 3.8 27B: 86.8%Vals AIAs of 10/26/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 79.5%Qwen 3.8 27B: 81.4%Vals AIAs of 10/13/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 90%Qwen 3.8 27B: 88.3%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalClaude Sonnet 4.6: 75.1%Qwen 3.8 27B: 85.8%Vals AIAs of 09/01/2026
Compare another matchup
More matchups
Related LLM comparisons
Compare Claude Sonnet 4.6 and Qwen 3.8 27B with other leading models.