Qwen 3.8 27Bvs.Mistral Medium 3.5
Which one is better?
Qwen 3.8 27B is clearly ahead in the overall index and is cheaper too: Mistral Medium 3.5 costs 37.5 times (input) and 3 times (output) as much per token.
11
Qwen 3.8 27B
Rank 44 to 57
below 1
Mistral Medium 3.5
Rank 78 to 92
40
Qwen 3.8 27B
slow
158
Mistral Medium 3.5
fairly fast
$0.66
Qwen 3.8 27B
fairly cheap
$3
Mistral Medium 3.5
fairly expensive
Qwen 3.8 27B
- Subscription
No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.
- Via API
$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.
Mistral Medium 3.5
- Subscription
Free to use at Mistral AI (Mistral Vibe Free), more from €7.13 a month (Mistral Vibe Pro Education). 5 plans in Germany.
- Via API
$1.50 input, $7.50 output per 1M tokens, more expensive since Oct 11, 2026 (before $0.40 and $2).
Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT
Where is the difference?
Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.
Qwen 3.8 27B ahead: 8Mistral Medium 3.5 ahead: 0level: 1too little data: 1of 10 areas
AreaQwen 3.8 27BMistral Medium 3.50 to 100, higher is betterResult
Areas in the overall index
CodingQwen 3.8 27B aheadQwen 3.8 27B: 13Mistral Medium 3.5: below 1
ReasoningQwen 3.8 27B aheadQwen 3.8 27B: 6Mistral Medium 3.5: below 1
MathematicsQwen 3.8 27B aheadQwen 3.8 27B: 8Mistral Medium 3.5: below 1
KnowledgeQwen 3.8 27B aheadQwen 3.8 27B: 5Mistral Medium 3.5: below 1
AgentsQwen 3.8 27B aheadQwen 3.8 27B: 21Mistral Medium 3.5: below 1
Generalonly Mistral Medium 3.5 has a scoreQwen 3.8 27B: not enough dataMistral Medium 3.5: below 1
MultimodalQwen 3.8 27B aheadQwen 3.8 27B: 13Mistral Medium 3.5: below 1
Specialist fields
FinanceQwen 3.8 27B aheadQwen 3.8 27B: 34Mistral Medium 3.5: below 1
LegalQwen 3.8 27B aheadQwen 3.8 27B: 23Mistral Medium 3.5: below 1
HealthlevelQwen 3.8 27B: 3Mistral Medium 3.5: below 1
Show 2 more areas that do not count toward the overall index
AreaQwen 3.8 27BMistral Medium 3.50 to 100, higher is betterResult
Cybersecurityonly Qwen 3.8 27B has a scoreQwen 3.8 27B: 19Mistral Medium 3.5: not enough data
Educationonly Mistral Medium 3.5 has a scoreQwen 3.8 27B: not enough dataMistral Medium 3.5: below 1
See for yourself: same task, one attempt
SVG short test
One SVG task with the same fixed settings for every model, without hidden thinking.
Shared test round: 43b8c5c46830
Qwen 3.8 27B
Test details
API reports 0 reasoning tokensAPI model: qwen/qwen3.8-27b865 output tokensMistral Medium 3.5
Test details
API reports 0 reasoning tokensAPI model: mistralai/mistral-medium-3-5502 output tokensEarlier tests
Pelican on a bicycle
A community classic for free-form SVG drawing.
Qwen 3.8 27B
Not tested yet
Mistral Medium 3.5
Reasoning (requested): high
Current attempt
- Run date
- Oct 1, 2026
- API provider
- openrouter
- Requested API model
- mistralai/mistral-medium-3-5
- API model reported in response
- mistralai/mistral-medium-3-5
- Reasoning setting
- high
- Pinned endpoint
- Mistral | mistralai/mistral-medium-3.5-20260430
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Test protocol
- community-visual-tests-v1
- Technical checks
- Passed, not a quality rating
- Response time
- 38.7 s
Visually reviewed. This individual test does not establish overall model quality.
Earlier attempts (1)
- Sep 7, 2026API request failedReasoning setting: high
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)All data side by side
The better value is bold. For the overall index only when the gap is clear.
| Metric | Qwen 3.8 27B | Mistral Medium 3.5 |
|---|---|---|
| Intelligence | ||
| Overall index0 to 100, higher is better | 11 | below 1 |
| Rank | Rank 44 to 57 of 95 | Rank 78 to 92 of 95 |
| Price per 1M tokens | ||
| Inputwhat you send | $0.04 | $1.50 |
| Outputwhat the model writes | $2.50 | $7.50 |
| Speed | ||
| Tokens per second | 40 | 158 |
| Technical | ||
| Context windowhow much text the model reads at once | 262,144 tokens≈ 390 A4 pages | 262,144 tokens≈ 390 A4 pages |
| Knowledge cutoff | n/a | n/a |
| Released | Aug 14, 2026 | Apr 28, 2026 |
| Availability | Active | Active |
| Open weights | yes | yes |
Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis
Shared benchmarks
Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.
A: Qwen 3.8 27BB: Mistral Medium 3.5
Code MigrationOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 14.2%Mistral Medium 3.5: 5.1%Vals AIAs of 10/18/2026
EMBOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 59.7%Mistral Medium 3.5: 11.2%Vals AIAs of 10/20/2026
Finance Agent (v2)Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 48.6%Mistral Medium 3.5: 32.1%Vals AIAs of 10/20/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 36.1%Mistral Medium 3.5: 9.1%Vals AIAs of 10/26/2026
MedCodeOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 28.7%Mistral Medium 3.5: 33.8%Vals AIAs of 10/13/2026
MedScribeOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 83.8%Mistral Medium 3.5: 67.7%Vals AIAs of 10/13/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 84.3%Mistral Medium 3.5: 75.3%Vals AIAs of 09/01/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 64.9%Mistral Medium 3.5: 28.9%Vals AIAs of 09/01/2026
ProofBench v1.1Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 16%Mistral Medium 3.5: 9%Vals AIAs of 10/24/2026
Show 54 more benchmarks
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 86%Mistral Medium 3.5: 66.4%Vals AIAs of 09/01/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 30.9%Mistral Medium 3.5: 4.5%Vals AIAs of 10/26/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.9%Mistral Medium 3.5: 68%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 58.4%Mistral Medium 3.5: 39%Vals AIAs of 10/01/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalQwen 3.8 27B: 64.9%Mistral Medium 3.5: 2.9%Vals AIAs of 10/26/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalQwen 3.8 27B: 2.2%Mistral Medium 3.5: 5%Vals AIAs of 10/18/2026
EMBComps · higher is betterTest setup not documented as identicalQwen 3.8 27B: 53.3%Mistral Medium 3.5: 18.1%Vals AIAs of 10/20/2026
Finance Agent (v2)Adjustments · higher is betterTest setup not documented as identicalQwen 3.8 27B: 47.3%Mistral Medium 3.5: 27.3%Vals AIAs of 10/20/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 45.5%Mistral Medium 3.5: 7.6%Vals AIAs of 10/26/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.5%Mistral Medium 3.5: 64.4%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalQwen 3.8 27B: 69.4%Mistral Medium 3.5: 11.9%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%Mistral Medium 3.5: 79.4%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 6.7%Mistral Medium 3.5: 3.3%Vals AIAs of 10/26/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.1%Mistral Medium 3.5: 56.7%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Easy · higher is betterTest setup not documented as identicalQwen 3.8 27B: 50%Mistral Medium 3.5: 66.7%Vals AIAs of 10/01/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalQwen 3.8 27B: 50%Mistral Medium 3.5: 5.5%Vals AIAs of 10/18/2026
EMBDataroom · higher is betterTest setup not documented as identicalQwen 3.8 27B: 79.7%Mistral Medium 3.5: 13.4%Vals AIAs of 10/20/2026
Finance Agent (v2)All-Pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 36.8%Mistral Medium 3.5: 21.6%Vals AIAs of 10/20/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.9%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.5%Mistral Medium 3.5: 67.5%Vals AIAs of 10/26/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalQwen 3.8 27B: 90.2%Mistral Medium 3.5: 64.4%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.5%Mistral Medium 3.5: 45.9%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalQwen 3.8 27B: 66.7%Mistral Medium 3.5: 33.3%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 48.3%Mistral Medium 3.5: 18.4%Vals AIAs of 10/26/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalQwen 3.8 27B: 81.6%Mistral Medium 3.5: 79.2%Vals AIAs of 09/01/2026
Terminal-Bench 2.1Hard · higher is betterTest setup not documented as identicalQwen 3.8 27B: 43.3%Mistral Medium 3.5: 15.6%Vals AIAs of 10/01/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalQwen 3.8 27B: 4.197 / 5Mistral Medium 3.5: 2.987 / 5Vals AIAs of 10/18/2026
EMBDCF · higher is betterTest setup not documented as identicalQwen 3.8 27B: 50%Mistral Medium 3.5: 2.2%Vals AIAs of 10/20/2026
Finance Agent (v2)Comparables · higher is betterTest setup not documented as identicalQwen 3.8 27B: 38.9%Mistral Medium 3.5: 31.5%Vals AIAs of 10/20/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 41.9%Mistral Medium 3.5: 9.3%Vals AIAs of 10/26/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalQwen 3.8 27B: 91.8%Mistral Medium 3.5: 73.1%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalQwen 3.8 27B: 69%Mistral Medium 3.5: 33.3%Vals AIAs of 09/01/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 43.1%Mistral Medium 3.5: 6.5%Vals AIAs of 10/26/2026
Terminal-Bench 2.1Medium · higher is betterTest setup not documented as identicalQwen 3.8 27B: 67.3%Mistral Medium 3.5: 49.7%Vals AIAs of 10/01/2026
EMBLBO · higher is betterTest setup not documented as identicalQwen 3.8 27B: 53.7%Mistral Medium 3.5: 9.6%Vals AIAs of 10/20/2026
Finance Agent (v2)Disclosure Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 60.3%Mistral Medium 3.5: 40.2%Vals AIAs of 10/20/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit · higher is betterTest setup not documented as identicalQwen 3.8 27B: 86.8%Mistral Medium 3.5: 71.3%Vals AIAs of 10/26/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.3%Mistral Medium 3.5: 82.9%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalQwen 3.8 27B: 85.8%Mistral Medium 3.5: 62.5%Vals AIAs of 09/01/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 58.6%Mistral Medium 3.5: 29.4%Vals AIAs of 10/26/2026
EMBM&A · higher is betterTest setup not documented as identicalQwen 3.8 27B: 64.8%Mistral Medium 3.5: 10.7%Vals AIAs of 10/20/2026
Finance Agent (v2)Earnings Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 70.9%Mistral Medium 3.5: 42.1%Vals AIAs of 10/20/2026
Legal Research BenchCivil Litigation · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 25.9%Mistral Medium 3.5: 11.1%Vals AIAs of 10/26/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalQwen 3.8 27B: 88.2%Mistral Medium 3.5: 78.2%Vals AIAs of 09/01/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 34.9%Mistral Medium 3.5: 2.3%Vals AIAs of 10/26/2026
EMBMisc · higher is betterTest setup not documented as identicalQwen 3.8 27B: 59.1%Mistral Medium 3.5: 14.1%Vals AIAs of 10/20/2026
Finance Agent (v2)Financial Modeling · higher is betterTest setup not documented as identicalQwen 3.8 27B: 19.3%Mistral Medium 3.5: 5.1%Vals AIAs of 10/20/2026
Legal Research BenchCivil Litigation · Weighted partial credit · higher is betterTest setup not documented as identicalQwen 3.8 27B: 83.1%Mistral Medium 3.5: 66%Vals AIAs of 10/26/2026
MMLU ProEngineering · higher is betterTest setup not documented as identicalQwen 3.8 27B: 82.4%Mistral Medium 3.5: 78.2%Vals AIAs of 09/01/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 57.7%Mistral Medium 3.5: 24.4%Vals AIAs of 10/26/2026
EMBOperating · higher is betterTest setup not documented as identicalQwen 3.8 27B: 57%Mistral Medium 3.5: 10.2%Vals AIAs of 10/20/2026
Finance Agent (v2)General Qualitative Analysis · higher is betterTest setup not documented as identicalQwen 3.8 27B: 62.1%Mistral Medium 3.5: 47.9%Vals AIAs of 10/20/2026
Legal Research BenchConstitutional / Civil Rights · All-pass · higher is betterTest setup not documented as identicalQwen 3.8 27B: 26.3%Mistral Medium 3.5: 10.5%Vals AIAs of 10/26/2026
Compare another matchup
More matchups
Related LLM comparisons
Compare Qwen 3.8 27B and Mistral Medium 3.5 with other leading models.