Head-to-head comparison
GLM-5.1 vs. Mistral Medium 3.5
Compare published benchmark results from matching versions and cohorts, API pricing, and technical specifications. Any documented test setup differences remain visible.
- shared result series
- 28
- distinct benchmarks
- 1
- latest retrieval
- 2026-09-04
Change model selection
Specifications
General specifications
Release date, availability, context window, architecture, and published parameter counts at a glance. Undisclosed details remain marked as unavailable.
| Attribute | GLM-5.1 | Mistral Medium 3.5 |
|---|---|---|
| Provider | Z.ai | Mistral AI |
| Released | Apr 7, 2026 | Apr 28, 2026 |
| Availability | Open Source | Active |
| Model type | Open Weights | Open Weights |
| Parameters | 744B, 40B active | Not published |
| Architecture | Mixture of Experts | Not published |
| Context window | 200,000 tokens | 256,000 tokens |
| Knowledge cutoff | Not published | Not published |
| Technical sources | Model, Context | Model |
Pricing
API pricing compared
The table compares official standard API rates per 1M tokens, including published cache pricing. Batch, fast, priority, regional surcharges, tool calls, and cloud platform pricing are excluded.
| Price type | GLM-5.1 | Mistral Medium 3.5 |
|---|---|---|
| API input | $1.4 | $1.5 |
| API output | $4.4 | $7.5 |
| Cache read | $0.26 | Not listed |
| Cache write (5 min.) | Not listed | Not listed |
| Cache write (1 hr.) | Not listed | Not listed |
| Price verified | 07/30/2026 Source | 07/30/2026 Source |
GLM-5.1Mistral Medium 3.5
API inputUSD per 1M tokens, base tier
GLM-5.1Lower price$1.4
Mistral Medium 3.5$1.5
API outputUSD per 1M tokens, base tier
GLM-5.1Lower price$4.4
Mistral Medium 3.5$7.5
Key to the marks:better valuebetter, but not conclusivetie
Pricing by provider
Direct developer pricing and provider endpoint tariffs routed through OpenRouter are listed separately. Prices are in USD per 1M tokens. Context-dependent direct tiers plus regional, Flex, Priority, and other OpenRouter tariffs remain individually identifiable.
| Model | Provider | Purchase route and tariff | Input per 1M tokens | Output per 1M tokens | Source |
|---|---|---|---|---|---|
| GLM-5.1 | Z.ai | Direct from developerStandard API | $1.4 | $4.4 | Source07/30/2026 |
| Alibaba | Via OpenRouteralibaba/fp8 | $1.33 | $4.18 | Source09/07/2026 | |
| AtlasCloud | Via OpenRouteratlas-cloud/fp8 | $1.26 | $3.96 | Source09/07/2026 | |
| Baidu | Via OpenRouterbaidu/fp8 | $1.4 | $4.4 | Source09/07/2026 | |
| Chutes | Via OpenRouterchutes/fp8 | $0.98 | $3.08 | Source09/07/2026 | |
| Crusoe | Via OpenRoutercrusoe/fp8 | $1.2 | $4.4 | Source09/07/2026 | |
| DeepInfra | Via OpenRouterdeepinfra/fp4 | $1.05 | $3.5 | Source09/07/2026 | |
| DigitalOcean | Via OpenRouterdigitalocean | $1.3 | $4.3 | Source09/07/2026 | |
| Friendli | Via OpenRouterfriendli | $1.4 | $4.4 | Source09/07/2026 | |
| GMICloud | Via OpenRoutergmicloud/fp8 | Lowest listed price: $0.91 | Lowest listed price: $2.86 | Source09/07/2026 | |
| Nebius | Via OpenRouternebius/fp8 | $1.4 | $4.4 | Source09/07/2026 | |
| Novita | Via OpenRouternovita/fp8 | $1.38 | $4.4 | Source09/07/2026 | |
| Phala | Via OpenRouterphala | $1.21 | $4.2 | Source09/07/2026 | |
| SiliconFlow | Via OpenRoutersiliconflow/fp8 | $1.19 | $3.74 | Source09/07/2026 | |
| StreamLake | Via OpenRouterstreamlake/fp8 | $0.966 | $3.036 | Source09/07/2026 | |
| Venice | Via OpenRoutervenice/fp8 | $1.54 | $4.84 | Source09/07/2026 | |
| Z.AI | Via OpenRouterz-ai/fp8 | $1.4 | $4.4 | Source09/07/2026 | |
| Mistral Medium 3.5 | Mistral AI | Direct from developerStandard API | Lowest listed price: $1.5 | Lowest listed price: $7.5 | Source07/30/2026 |
| Mistral | Via OpenRoutermistral | Lowest listed price: $1.5 | Lowest listed price: $7.5 | Source09/07/2026 | |
| Mistral | Via OpenRoutermistral/eu | $1.65 | $8.25 | Source09/07/2026 | |
| Mistral | Via OpenRoutermistral/zdr | Lowest listed price: $1.5 | Lowest listed price: $7.5 | Source09/07/2026 |
Performance
Shared benchmarks
Only published results with the same benchmark version, task, metric, and comparison cohort are paired. Different reasoning levels, agents, harnesses, or output limits appear directly in the table.
Capability profile from matched benchmarks
Each axis averages directly matched benchmark families. A value of 100 means the stronger value within this pair, not a universal quality score.
GLM-5.1
Mistral Medium 3.5
Coding: 100 / 97.7 (1 benchmark family)
Reasoning: 100 / 96.9 (1 benchmark family)
Mathematics: 100 / 97.2 (1 benchmark family)
Knowledge: 100 / 96.6 (1 benchmark family)
Finance: 100 / 97.7 (1 benchmark family)
Legal: 100 / 97.4 (1 benchmark family)
Health: 100 / 95.9 (1 benchmark family)
General: 100 / 96.9 (1 benchmark family)
28 matched rows from 1 benchmark families were considered. The radar shows 8 of 8 comparable categories.
GLM-5.1Mistral Medium 3.5
LMArena Text, Style ControlOverall. Higher is better. No documented setup difference
GLM-5.1Winner1,466.019
Mistral Medium 3.51,426.98
LMArena Text, Style ControlBusiness, management and finance. Higher is better. No documented setup difference
GLM-5.1Winner1,464.877
Mistral Medium 3.51,431.113
LMArena Text, Style ControlChinese. Higher is better. No documented setup difference
GLM-5.1Winner1,516.722
Mistral Medium 3.51,448.299
LMArena Text, Style ControlCoding. Higher is better. No documented setup difference
GLM-5.1Winner1,513.669
Mistral Medium 3.51,478.845
LMArena Text, Style ControlCreative writing. Higher is better. No documented setup difference
GLM-5.1Winner1,447.489
Mistral Medium 3.51,396.971
LMArena Text, Style ControlEnglish. Higher is better. No documented setup difference
GLM-5.1Winner1,480.022
Mistral Medium 3.51,444.656
LMArena Text, Style ControlEntertainment, sports and media. Higher is better. No documented setup difference
GLM-5.1Winner1,442.227
Mistral Medium 3.51,396.875
LMArena Text, Style ControlExcluding ties. Higher is better. No documented setup difference
GLM-5.1Winner1,472.225
Mistral Medium 3.51,421.17
LMArena Text, Style ControlExpert prompts. Higher is better. No documented setup difference
GLM-5.1Winner1,495.539
Mistral Medium 3.51,438.278
LMArena Text, Style ControlFrench. Higher is better. No documented setup difference
GLM-5.1Winner1,486.176
Mistral Medium 3.51,436.08
LMArena Text, Style ControlGerman. Higher is better. No documented setup difference
GLM-5.1No clear lead1,467.247
Mistral Medium 3.51,442.607
LMArena Text, Style ControlHard prompts. Higher is better. No documented setup difference
GLM-5.1Winner1,488.383
Mistral Medium 3.51,445.592
Key to the marks:better valuebetter, but not conclusivetie
| Benchmark and task | GLM-5.1 | Mistral Medium 3.5 | Source |
|---|---|---|---|
LMArena Text, Style ControlOverallTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 45,403 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 11,017 anonymous pairwise votes. | Winner1,466.019 95% confidence interval: ±3.982The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,426.98 95% confidence interval: ±6.556The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlBusiness, management and financeTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 9,036 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 2,148 anonymous pairwise votes. | Winner1,464.877 95% confidence interval: ±7.07The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,431.113 95% confidence interval: ±13.17The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlChineseTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 2,742 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 500 anonymous pairwise votes. | Winner1,516.722 95% confidence interval: ±12.084The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,448.299 95% confidence interval: ±26.61The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlCodingTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 12,659 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 3,079 anonymous pairwise votes. | Winner1,513.669 95% confidence interval: ±6.252The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,478.845 95% confidence interval: ±11.157The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlCreative writingTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 8,409 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 1,862 anonymous pairwise votes. | Winner1,447.489 95% confidence interval: ±7.46The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,396.971 95% confidence interval: ±14.389The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlEnglishTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 20,248 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 5,299 anonymous pairwise votes. | Winner1,480.022 95% confidence interval: ±5.164The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,444.656 95% confidence interval: ±8.682The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlEntertainment, sports and mediaTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 10,350 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 2,453 anonymous pairwise votes. | Winner1,442.227 95% confidence interval: ±6.829The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,396.875 95% confidence interval: ±12.491The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlExcluding tiesTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 34,041 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 8,299 anonymous pairwise votes. | Winner1,472.225 95% confidence interval: ±5.215The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,421.17 95% confidence interval: ±8.686The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlExpert promptsTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 4,692 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 1,110 anonymous pairwise votes. | Winner1,495.539 95% confidence interval: ±9.271The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,438.278 95% confidence interval: ±17.831The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlFrenchTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 1,617 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 438 anonymous pairwise votes. | Winner1,486.176 95% confidence interval: ±16.508The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,436.08 95% confidence interval: ±30.551The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlGermanTest detailsNo documented difference in the test setupNo clear leadVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 725 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 170 anonymous pairwise votes. | No clear lead1,467.247 95% confidence interval: ±22.694The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,442.607 95% confidence interval: ±44.317The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlHard promptsTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 29,974 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 7,154 anonymous pairwise votes. | Winner1,488.383 95% confidence interval: ±4.664The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,445.592 95% confidence interval: ±7.857The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlHard prompts, EnglishTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 13,642 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 3,629 anonymous pairwise votes. | Winner1,497.156 95% confidence interval: ±6.069The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,458.246 95% confidence interval: ±10.39The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlInstruction followingTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 15,738 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 3,561 anonymous pairwise votes. | Winner1,459.874 95% confidence interval: ±5.685The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,422.491 95% confidence interval: ±10.335The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlKoreanTest detailsNo documented difference in the test setupNo clear leadVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 906 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 178 anonymous pairwise votes. | No clear lead1,420.706 95% confidence interval: ±20.976The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,394.42 95% confidence interval: ±44.572The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlLegal and governmentTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 3,614 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 839 anonymous pairwise votes. | Winner1,475.668 95% confidence interval: ±10.397The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,437.785 95% confidence interval: ±21.302The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlLife, physical and social scienceTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 7,449 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 1,823 anonymous pairwise votes. | Winner1,486.607 95% confidence interval: ±7.514The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,433.494 95% confidence interval: ±14.359The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlLonger queriesTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 20,421 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 4,661 anonymous pairwise votes. | Winner1,481.572 95% confidence interval: ±5.447The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,430.723 95% confidence interval: ±9.428The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlMathTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 2,234 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 539 anonymous pairwise votes. | Winner1,476.724 95% confidence interval: ±12.928The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,429.582 95% confidence interval: ±24.872The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlMathematical professionsTest detailsNo documented difference in the test setupNo clear leadVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 2,428 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 597 anonymous pairwise votes. | No clear lead1,477.716 95% confidence interval: ±12.657The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,442.192 95% confidence interval: ±23.932The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlMedicine and healthcareTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 3,296 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 802 anonymous pairwise votes. | Winner1,483.9 95% confidence interval: ±11.02The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,423.47 95% confidence interval: ±21.791The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlMulti-turnTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 7,394 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 1,803 anonymous pairwise votes. | Winner1,477.368 95% confidence interval: ±7.627The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,431.302 95% confidence interval: ±14.433The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlNon-EnglishTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 25,154 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 5,718 anonymous pairwise votes. | Winner1,450.468 95% confidence interval: ±4.796The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,406.687 95% confidence interval: ±8.36The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlPolishTest detailsNo documented difference in the test setupNo clear leadVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 886 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 226 anonymous pairwise votes. | No clear lead1,447.998 95% confidence interval: ±19.624The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,407.955 95% confidence interval: ±38.858The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlRussianTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 4,884 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 1,143 anonymous pairwise votes. | Winner1,461.171 95% confidence interval: ±8.951The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,415.692 95% confidence interval: ±17.832The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlSoftware and IT servicesTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 18,168 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 4,320 anonymous pairwise votes. | Winner1,501.543 95% confidence interval: ±5.397The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,470.76 95% confidence interval: ±9.541The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlSpanishTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 1,538 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 377 anonymous pairwise votes. | Winner1,461.467 95% confidence interval: ±16.167The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,386.845 95% confidence interval: ±32.418The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
LMArena Text, Style ControlWriting, literature and languageTest detailsNo documented difference in the test setupVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterGLM-5.1: Snapshot: glm-5.1, Harness: Arena text, style control Mistral Medium 3.5: Snapshot: mistral-medium-3.5, Harness: Arena text, style controlGLM-5.1: Style-controlled Arena rating from 11,635 anonymous pairwise votes.Mistral Medium 3.5: Style-controlled Arena rating from 2,734 anonymous pairwise votes. | Winner1,454.24 95% confidence interval: ±6.448The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | 1,405.944 95% confidence interval: ±11.74The Arena score measures human preference rather than a fixed capability test. The confidence interval and model configuration are part of the result. | LMArenaSource detailsData as of: 09/01/2026 |
Key to the marks:better valuebetter, but not conclusivetie | |||
How to read this comparison
Winning one benchmark is not an overall verdict
Your workload, budget, and required context length matter most. A coding benchmark says little about visual understanding or agent performance.
The standard price table uses direct developer rates. The provider comparison labels OpenRouter endpoints, regions, and special tariffs separately.
Every result links to its measurement source and retrieval date. Labels distinguish vendor reports, official benchmark leaderboards, and independent evaluations. Disputed or archived results are excluded.
More matchups
Related LLM comparisons
Compare GLM-5.1 and Mistral Medium 3.5 with other leading models using the same data and benchmark logic.