Qwen 3.8 Max 0902
Unavailable in this round
Head-to-head comparison
Compare published benchmark results from matching versions and cohorts, API pricing, and technical specifications. Any documented test setup differences remain visible.
Specifications
Release date, availability, context window, architecture, and published parameter counts at a glance. Undisclosed details remain marked as unavailable.
| Attribute | Qwen 3.8 Max 0902 | Mistral Large 3 |
|---|---|---|
| Provider | Alibaba | Mistral AI |
| Released | Sep 2, 2026 | Dec 2, 2025 |
| Availability | API-only | Active |
| Model type | Proprietary | Open Weights |
| Parameters | 2.4T | 675B, 41B active |
| Architecture | Mixture of Experts | Mixture of Experts |
| Context window | 1,000,000 tokens | 262,144 tokens |
| Knowledge cutoff | Not published | Not published |
| Technical sources | Model | Model, Context |
Pricing
The table compares official standard API rates per 1M tokens, including published cache pricing. Batch, fast, priority, regional surcharges, tool calls, and cloud platform pricing are excluded.
| Price type | Qwen 3.8 Max 0902 | Mistral Large 3 |
|---|---|---|
| API input | $1.65 | $0.5 |
| API output | $4.951 | $1.5 |
| Cache read | $0.137 | Not listed |
| Cache write (5 min.) | Not listed | Not listed |
| Cache write (1 hr.) | Not listed | Not listed |
| Price verified | 09/22/2026 Source | 09/22/2026 Source |
Key to the marks:better valuebetter, but not conclusivetie
Direct developer pricing and provider endpoint tariffs routed through OpenRouter are listed separately. Prices are in USD per 1M tokens. Context-dependent direct tiers plus regional, Flex, Priority, and other OpenRouter tariffs remain individually identifiable.
| Model | Provider | Purchase route and tariff | Input per 1M tokens | Output per 1M tokens | Source |
|---|---|---|---|---|---|
| Qwen 3.8 Max 0902 | Alibaba | Direct from developerStandard API | Lowest listed price: $1.65 | Lowest listed price: $4.951 | Source09/22/2026 |
| Alibaba | Via OpenRouteralibaba | $2 | $6 | Source10/18/2026 | |
| Alibaba | Via OpenRouteralibaba/us-east-1 | $2 | $6 | Source10/18/2026 | |
| Mistral Large 3 | Mistral AI | Direct from developerStandard API | Lowest listed price: $0.5 | Lowest listed price: $1.5 | Source09/22/2026 |
| Mistral | Via OpenRoutermistral/eu | $0.55 | $1.65 | Source10/18/2026 | |
| Mistral | Via OpenRoutermistral/zdr | Lowest listed price: $0.5 | Lowest listed price: $1.5 | Source10/18/2026 |
Performance
Only published results with the same benchmark version, task, metric, and comparison cohort are paired. Different reasoning levels, agents, harnesses, or output limits appear directly in the table.
Each axis averages directly matched benchmark families. A value of 100 means the stronger value within this pair, not a universal quality score.
Not enough directly matched categories for a reliable radar
Only 2 of at least 5 categories have comparable, direct model measurements. The benchmark tables below show the available evidence without filling missing axes.
Key to the marks:better valuebetter, but not conclusivetie
| Benchmark and task | Qwen 3.8 Max 0902 | Mistral Large 3 | Source |
|---|---|---|---|
CorpFin v2OverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value65.851 % | 61.033 % | Vals AISource detailsData as of: 08/12/2026 |
GPQA DiamondOverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value93.686 % | 68.434 % | Vals AISource detailsData as of: 09/01/2026 |
LegalBenchOverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value83.609 % | 79.138 % | Vals AISource detailsData as of: 10/13/2026 |
LiveCodeBench v6OverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value87.852 % | 55.337 % | Vals AISource detailsData as of: 09/01/2026 |
LMArena Code Arena WebDevOverallTest detailsNo documented difference in the test setupVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterQwen 3.8 Max 0902: Snapshot: qwen3.8-max-0902, Harness: Arena Code Arena WebDev Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDevQwen 3.8 Max 0902: Arena rating from 13,081 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes. | Winner1,673.151 95% confidence interval: ±7.241The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | 1,230.205 95% confidence interval: ±25.485The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | LMArenaSource detailsData as of: 10/13/2026 |
MMLU-ProOverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value88.602 % | 79.823 % | Vals AISource detailsData as of: 09/01/2026 |
MMMU-ProOverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value88.035 % | 66.185 % | Vals AISource detailsData as of: 09/01/2026 |
MortgageTaxOverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value63.99 % | 52.106 % | Vals AISource detailsData as of: 09/01/2026 |
SAGEOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Temperature: 1, Output limit: 30,000 tokens | Winner51.254 % | 24.595 % | Vals AISource detailsData as of: 10/08/2026 |
SWE-bench VerifiedOverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value85.6 % | 41.4 % | Vals AISource detailsData as of: 09/01/2026 |
TaxEval v2OverallTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value75.552 % | 73.058 % | Vals AISource detailsData as of: 09/01/2026 |
CorpFin v2Exact PagesTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value64.569 % | 59.79 % | Vals AISource detailsData as of: 08/12/2026 |
GPQA DiamondFew-Shot CoTTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value92.424 % | 64.141 % | Vals AISource detailsData as of: 09/01/2026 |
LegalBenchConclusion TasksTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value88.23 % | 81.032 % | Vals AISource detailsData as of: 10/13/2026 |
LiveCodeBench v6EasyTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value99.068 % | 95.342 % | Vals AISource detailsData as of: 09/01/2026 |
LMArena Code Arena WebDevImage to webdevTest detailsNo documented difference in the test setupVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterQwen 3.8 Max 0902: Snapshot: qwen3.8-max-0902, Harness: Arena Code Arena WebDev Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDevQwen 3.8 Max 0902: Arena rating from 1,164 published pairwise votes.Mistral Large 3: Arena rating from 1,413 published pairwise votes. | Winner1,637.891 95% confidence interval: ±18.343The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | 1,361.78 95% confidence interval: ±17.387The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | LMArenaSource detailsData as of: 10/09/2026 |
MMLU-ProBiologyTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value94.142 % | 88.563 % | Vals AISource detailsData as of: 09/01/2026 |
MortgageTaxNumerical ExtractionTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value72.258 % | 50 % | Vals AISource detailsData as of: 09/01/2026 |
SAGEAutomataTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Temperature: 1, Output limit: 30,000 tokens | Winner39.682 % | 11.905 % | Vals AISource detailsData as of: 10/08/2026 |
SWE-bench Verified<15 min fixTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value93.299 % | 56.186 % | Vals AISource detailsData as of: 09/01/2026 |
TaxEval v2CorrectnessTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value64.105 % | 61.57 % | Vals AISource detailsData as of: 09/01/2026 |
CorpFin v2Max Fitting ContextTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value65.618 % | 63.753 % | Vals AISource detailsData as of: 08/12/2026 |
GPQA DiamondZero-Shot CoTTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value94.949 % | 72.727 % | Vals AISource detailsData as of: 09/01/2026 |
LegalBenchInterpretation TasksTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value84.061 % | 76.594 % | Vals AISource detailsData as of: 10/13/2026 |
LiveCodeBench v6HardTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value75.714 % | 17.143 % | Vals AISource detailsData as of: 09/01/2026 |
LMArena Code Arena WebDevWebdevTest detailsNo documented difference in the test setupVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterQwen 3.8 Max 0902: Snapshot: qwen3.8-max-0902, Harness: Arena Code Arena WebDev Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDevQwen 3.8 Max 0902: Arena rating from 13,081 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes. | Winner1,673.151 95% confidence interval: ±7.241The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | 1,230.205 95% confidence interval: ±25.485The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | LMArenaSource detailsData as of: 10/13/2026 |
MMLU-ProBusinessTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value92.902 % | 84.664 % | Vals AISource detailsData as of: 09/01/2026 |
MortgageTaxSemantic ExtractionTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value55.723 % | 54.213 % | Vals AISource detailsData as of: 09/01/2026 |
SAGECalculusTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Temperature: 1, Output limit: 30,000 tokens | Winner71.914 % | 0 % | Vals AISource detailsData as of: 10/08/2026 |
SWE-bench Verified>4 hoursTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value66.667 % | 33.333 % | Vals AISource detailsData as of: 09/01/2026 |
TaxEval v2Stepwise ReasoningTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value86.999 % | 84.546 % | Vals AISource detailsData as of: 09/01/2026 |
CorpFin v2Shared Max ContextTest detailsTest setup not documented as identicalNo direct winnerVersion: 2Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value67.366 % | 59.557 % | Vals AISource detailsData as of: 08/12/2026 |
LegalBenchIssue TasksTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value90.635 % | 81.006 % | Vals AISource detailsData as of: 10/13/2026 |
LiveCodeBench v6MediumTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value88.773 % | 53.525 % | Vals AISource detailsData as of: 09/01/2026 |
LMArena Code Arena WebDevWebdev-htmlTest detailsNo documented difference in the test setupVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterQwen 3.8 Max 0902: Snapshot: qwen3.8-max-0902, Harness: Arena Code Arena WebDev Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDevQwen 3.8 Max 0902: Arena rating from 2,257 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes. | Winner1,651.307 95% confidence interval: ±14.717The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | 1,238.427 95% confidence interval: ±26.132The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result. | LMArenaSource detailsData as of: 10/13/2026 |
MMLU-ProChemistryTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value92.491 % | 84.982 % | Vals AISource detailsData as of: 09/01/2026 |
SAGELinear AlgebraTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Temperature: 1, Output limit: 30,000 tokens | Winner69.636 % | 44.419 % | Vals AISource detailsData as of: 10/08/2026 |
SWE-bench Verified1-4 hoursTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value64.286 % | 4.762 % | Vals AISource detailsData as of: 09/01/2026 |
LegalBenchRhetoric TasksTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value79.047 % | 77.926 % | Vals AISource detailsData as of: 10/13/2026 |
MMLU-ProComputer ScienceTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value90.976 % | 83.171 % | Vals AISource detailsData as of: 09/01/2026 |
SAGEPartial Differential EquationsTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Temperature: 1, Output limit: 30,000 tokens | Winner44.444 % | 17.46 % | Vals AISource detailsData as of: 10/08/2026 |
SWE-bench Verified15 min - 1 hourTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value83.525 % | 36.398 % | Vals AISource detailsData as of: 09/01/2026 |
LegalBenchRule TasksTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | 76.071 % | Higher measured value79.13 % | Vals AISource detailsData as of: 10/13/2026 |
MMLU-ProEconomicsTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value89.929 % | 85.782 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProEngineeringTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value86.687 % | 74.923 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProHealthTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value83.985 % | 77.262 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProHistoryTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value81.102 % | 70.866 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProLawTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value77.293 % | 56.403 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProMathTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value95.485 % | 88.379 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProOthersTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value85.281 % | 79.221 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProPhilosophyTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value88.377 % | 76.353 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProPhysicsTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value93.303 % | 86.374 % | Vals AISource detailsData as of: 09/01/2026 |
MMLU-ProPsychologyTest detailsTest setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterQwen 3.8 Max 0902: Temperature: 0.7, Output limit: 128,000 tokens Mistral Large 3: Temperature: 0.065, Output limit: 256,000 tokens | Higher measured value88.471 % | 80.576 % | Vals AISource detailsData as of: 09/01/2026 |
Key to the marks:better valuebetter, but not conclusivetie | |||
Our model tests
One SVG prompt and fixed output settings. Captures are shown only with 0 reported reasoning tokens or documented lack of reasoning controls. Identical test conditions do not make the models' internal compute identical.
Shared test round: 4ae5d8eeb9a9
Unavailable in this round
API request failed. The model was not evaluated.
A community classic for free-form SVG drawing.
Qwen 3.8 Max 0902
The response reached the token limit. No complete recording is available.
Reasoning (requested): high
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Mistral Large 3

Reasoning (model default): no reasoning mode Source
Visually reviewed. This individual test does not establish overall model quality.
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)How to read this comparison
Your workload, budget, and required context length matter most. A coding benchmark says little about visual understanding or agent performance.
The standard price table uses direct developer rates. The provider comparison labels OpenRouter endpoints, regions, and special tariffs separately.
Every result links to its measurement source and retrieval date. Labels distinguish vendor reports, official benchmark leaderboards, and independent evaluations. Disputed or archived results are excluded.
More matchups
Compare Qwen 3.8 Max 0902 and Mistral Large 3 with other leading models using the same data and benchmark logic.