Skip to main content

Qwen 3.8 27Bvs.Mistral Large 3

Which one is better?

Qwen 3.8 27B is clearly ahead in the overall index. Qwen 3.8 27B is cheaper for input, Mistral Large 3 for output.

IntelligenceOverall index, 0 to 100 · higher is better
11

Qwen 3.8 27B

Rank 44 to 57

below 1

Mistral Large 3

Rank 88 to 94

SpeedTokens per second · higher is better
40

Qwen 3.8 27B

slow

84

Mistral Large 3

fairly slow

PriceDollars per 1M tokens · lower is better
$0.66

Qwen 3.8 27B

fairly cheap

$0.75

Mistral Large 3

fairly cheap

Qwen 3.8 27B

Subscription

No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.

Via API

$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.

Mistral Large 3

Subscription

No Mistral AI subscription includes this model. Through other providers only in team or business plans, from €29.75 a month per seat (Langdock Business Standard). 2 plans in Germany.

Via API

$0.50 input, $1.50 output per 1M tokens, unchanged since our price tracking began on Aug 14, 2026.

Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT

Where is the difference?

Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.

Qwen 3.8 27B ahead: 9Mistral Large 3 ahead: 0level: 0too little data: 1of 10 areas

Qwen 3.8 27BMistral Large 30 to 100, higher is better
Areas in the overall index
CodingQwen 3.8 27B aheadQwen 3.8 27B: 13Mistral Large 3: below 1
ReasoningQwen 3.8 27B aheadQwen 3.8 27B: 6Mistral Large 3: below 1
MathematicsQwen 3.8 27B aheadQwen 3.8 27B: 8Mistral Large 3: below 1
KnowledgeQwen 3.8 27B aheadQwen 3.8 27B: 5Mistral Large 3: below 1
AgentsQwen 3.8 27B aheadQwen 3.8 27B: 21Mistral Large 3: below 1
Generalonly Mistral Large 3 has a scoreQwen 3.8 27B: not enough dataMistral Large 3: below 1
MultimodalQwen 3.8 27B aheadQwen 3.8 27B: 13Mistral Large 3: below 1
Specialist fields
FinanceQwen 3.8 27B aheadQwen 3.8 27B: 34Mistral Large 3: below 1
LegalQwen 3.8 27B aheadQwen 3.8 27B: 23Mistral Large 3: below 1
HealthQwen 3.8 27B aheadQwen 3.8 27B: 3Mistral Large 3: below 1
Show 1 more areas that do not count toward the overall index
Qwen 3.8 27BMistral Large 30 to 100, higher is better
Cybersecurityonly Qwen 3.8 27B has a scoreQwen 3.8 27B: 19Mistral Large 3: not enough data

See for yourself: same task, one attempt

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Shared test round: 43b8c5c46830

Qwen 3.8 27B

Qwen 3.8 27B: SVG short test
Test run: Oct 14, 2026 · alibaba
Test detailsAPI reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokens

Mistral Large 3

API request failed. The model was not evaluated.

Earlier tests

Pelican on a bicycle

A community classic for free-form SVG drawing.

Qwen 3.8 27B

Not tested yet

Mistral Large 3

Mistral Large 3: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (model default): no reasoning mode Source

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
mistralai/mistral-large-2512
API model reported in response
mistralai/mistral-large-2512
Reasoning setting
not specified
Pinned endpoint
Mistral | mistralai/mistral-large-2512
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
14.2 s

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)
  • Sep 7, 2026API request failedReasoning setting: not specified
Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricQwen 3.8 27BMistral Large 3
Intelligence
Overall index0 to 100, higher is better11below 1
RankRank 44 to 57 of 95Rank 88 to 94 of 95
Price per 1M tokens
Inputwhat you send$0.04$0.50
Outputwhat the model writes$2.50$1.50
Speed
Tokens per second4084
Technical
Context windowhow much text the model reads at once262,144 tokens≈ 390 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffn/an/a
ReleasedAug 14, 2026Dec 2, 2025
AvailabilityActiveActive
Open weightsyesyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: Qwen 3.8 27BB: Mistral Large 3

GPQA DiamondOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%Mistral Large 3: 68.4%Vals AIAs of 09/01/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 82.4%Mistral Large 3: 79.1%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 84%Mistral Large 3: 55.3%Vals AIAs of 09/01/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 84.3%Mistral Large 3: 79.8%Vals AIAs of 09/01/2026
MMMU ProOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 83.9%Mistral Large 3: 66.2%Vals AIAs of 09/01/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 64.9%Mistral Large 3: 52.1%Vals AIAs of 09/01/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 86%Mistral Large 3: 41.4%Vals AIAs of 09/01/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.9%Mistral Large 3: 73.1%Vals AIAs of 09/01/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%Mistral Large 3: 64.1%Vals AIAs of 09/01/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.4%Mistral Large 3: 81%Vals AIAs of 10/13/2026
Show 30 more benchmarks
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalQwen 3.8 27B: 99.1%Mistral Large 3: 95.3%Vals AIAs of 09/01/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.5%Mistral Large 3: 88.6%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalQwen 3.8 27B: 69.4%Mistral Large 3: 50%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%Mistral Large 3: 56.2%Vals AIAs of 09/01/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.1%Mistral Large 3: 61.6%Vals AIAs of 09/01/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%Mistral Large 3: 72.7%Vals AIAs of 09/01/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 82%Mistral Large 3: 76.6%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalQwen 3.8 27B: 65.7%Mistral Large 3: 17.1%Vals AIAs of 09/01/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%Mistral Large 3: 84.7%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.5%Mistral Large 3: 54.2%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalQwen 3.8 27B: 66.7%Mistral Large 3: 33.3%Vals AIAs of 09/01/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalQwen 3.8 27B: 81.6%Mistral Large 3: 84.5%Vals AIAs of 09/01/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%Mistral Large 3: 81%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalQwen 3.8 27B: 87.2%Mistral Large 3: 53.5%Vals AIAs of 09/01/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.8%Mistral Large 3: 85%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalQwen 3.8 27B: 69%Mistral Large 3: 4.8%Vals AIAs of 09/01/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 81.4%Mistral Large 3: 77.9%Vals AIAs of 10/13/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.3%Mistral Large 3: 83.2%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalQwen 3.8 27B: 85.8%Mistral Large 3: 36.4%Vals AIAs of 09/01/2026
LegalBenchRule Tasks · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.2%Mistral Large 3: 79.1%Vals AIAs of 10/13/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.2%Mistral Large 3: 85.8%Vals AIAs of 09/01/2026
MMLU ProEngineering · higher is betterTest setup not documented as identicalQwen 3.8 27B: 82.4%Mistral Large 3: 74.9%Vals AIAs of 09/01/2026
MMLU ProHealth · higher is betterTest setup not documented as identicalQwen 3.8 27B: 78.6%Mistral Large 3: 77.3%Vals AIAs of 09/01/2026
MMLU ProHistory · higher is betterTest setup not documented as identicalQwen 3.8 27B: 75.6%Mistral Large 3: 70.9%Vals AIAs of 09/01/2026
MMLU ProLaw · higher is betterTest setup not documented as identicalQwen 3.8 27B: 67.8%Mistral Large 3: 56.4%Vals AIAs of 09/01/2026
MMLU ProMath · higher is betterTest setup not documented as identicalQwen 3.8 27B: 94.8%Mistral Large 3: 88.4%Vals AIAs of 09/01/2026
MMLU ProOthers · higher is betterTest setup not documented as identicalQwen 3.8 27B: 76.8%Mistral Large 3: 79.2%Vals AIAs of 09/01/2026
MMLU ProPhilosophy · higher is betterTest setup not documented as identicalQwen 3.8 27B: 78.6%Mistral Large 3: 76.4%Vals AIAs of 09/01/2026
MMLU ProPhysics · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.3%Mistral Large 3: 86.4%Vals AIAs of 09/01/2026
MMLU ProPsychology · higher is betterTest setup not documented as identicalQwen 3.8 27B: 84.8%Mistral Large 3: 80.6%Vals AIAs of 09/01/2026

Compare another matchup