Skip to main content

Z.aiMistral AILLM matchup

GLM-5.1vs.Mistral Large 3

Which one is better?

GLM-5.1 performs better than Mistral Large 3, but costs 2.9 times as much.

GLM-5.1 ahead
IntelligenceOverall index, 100 points = average
82.8

GLM-5.1

Rank 56

32.7

Mistral Large 3

Rank 95

Mistral Large 3 faster
SpeedTokens per second
46

GLM-5.1

57

Mistral Large 3

Mistral Large 3 cheaper
Price$ per 1M tokens
$2.15

GLM-5.1

$0.75

Mistral Large 3

GLM-5.1 more popular
Popularity0 to 100
62

GLM-5.1

Rank 66 of 511

48

Mistral Large 3

Rank 150 of 511

Choose GLM-5.1 for

CodingFinance

No clear advantage for Mistral Large 3.

Where is the difference?

GLM-5.1 is ahead in 2 of 10 areas, Mistral Large 3 in none.

GLM-5.1 ahead: 2too little data: 8

Areas in the overall index
CodingGLM-5.1 +4981.1 to 31.9
Generaltoo little data86.4 to 33.4
Agentstoo little data85.7 to 34.3
Knowledgetoo little data83.3 to 38.4
Reasoningtoo little data79.1 to 34.3
Mathematicsonly Mistral Large 3 has a score
Multimodalonly Mistral Large 3 has a score
Specialist fields
FinanceGLM-5.1 +4283.1 to 41.3
Legaltoo little data87.5 to 39.7
Healthtoo little data76.8 to 30.9

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Show 1 more areas that do not count toward the overall index
Productivityonly GLM-5.1 has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Which model for which task?

Everyday tasks, translated from the area values above. Each row names the values it rests on.

Writing and debugging codeGLM-5.1Coding 81.1 to 31.9
Maths and data analysisopenMathematics without a score for GLM-5.1, Reasoning 79.1 to 34.3 (too little data)
Facts and researchopenKnowledge 83.3 to 38.4 (too little data)
Agents and workflowsopenAgents 85.7 to 34.3 (too little data)
Fast chat repliesMistral Large 346 to 57 tokens per second
Many requests on a small budgetMistral Large 3$2.15 to $0.75 per 1M tokens
Finance, legal and medical textsGLM-5.1Finance 83.1 to 41.3, Legal 87.5 to 39.7 (too little data), Health 76.8 to 30.9 (too little data)
Images, screenshots and PDFsopenMultimodal without a score for GLM-5.1

GLM-5.1 vs. Mistral Large 3 in our own test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Prompt

Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.

GLM-5.1

GLM-5.1: SVG short test

Oct 14, 2026 · $0.0027

Test details
Test run
Oct 14, 2026
Provider
z-ai/fp8
API model
z-ai/glm-5.1
Output
580 tokens
Reasoning
API reports 0 reasoning tokens
Cost of the attempt
$0.0027
Test round
43b8c5c46830

Mistral Large 3

API request failed. The model was not evaluated.

Earlier tests

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Task origin: Simon Willison

GLM-5.1

Output withheld for safety

Oct 5, 2026 · 142 s · $0.03

Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.

Test details
Run date
Oct 5, 2026
API provider
openrouter
Requested API model
z-ai/glm-5.1
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
6,031 tokens
Cost of the attempt
$0.0266
Response time
141.6 s
API model reported in response
z-ai/glm-5.1
Pinned endpoint
Z.AI | z-ai/glm-5.1-20260406
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Failed

Earlier attempts (3)

  • Oct 2, 2026Output withheld for safetyReasoning setting: high
  • Oct 1, 2026API request failedReasoning setting: high
  • Sep 7, 2026API request failedReasoning setting: high

Mistral Large 3

Mistral Large 3: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 14 s · $0.0022

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
mistralai/mistral-large-2512
Reasoning setting
not specified
Token limit including reasoning
8,192 tokens
Output tokens
1,451 tokens
Cost of the attempt
$0.0022
Response time
14.2 s
API model reported in response
mistralai/mistral-large-2512
Pinned endpoint
Mistral | mistralai/mistral-large-2512
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Reasoning (model default)
no reasoning mode Source

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: not specified

GLM-5.1 and Mistral Large 3 in the overall index

Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.

Overall index (Gradually Meta-Score v6)

20 of 95 models

Claude Fable 5.2max130.9
Gemini 4 Carbonhigh127.0
Claude Opus 5.5max125.7
Claude Fable 5.1max124.1
Claude Sonnet 5.5max121.9
Gemini 4 Argonhigh121.2
GPT-6 Astramax119.6
Muse Wonder Fullmax118.4
GPT-6.1 Solmax117.5
Claude Opus 5max117.3
Muse Wondermax113.7
Claude Fable 5max112.8
Kimi K3.1 Promax112.6
Muse Ember 1.0max110.5
GPT-5.6 Solmax109.3
GPT-6 Solmax108.4
Gemini 3.7 Flashhigh107.7
DeepSeek V4.1 Flash 1017max107.1
GLM-5.182.8
Mistral Large 3none32.7

Popularity compared

How often the models are searched for, used and mentioned, on a scale from 0 to 100.

GLM-5.1 is more popular than Mistral Large 3: 62 to 48 out of 100.

Over time

Weekly values from October 18, 2026 to November 17, 2026

GLM-5.1Mistral Large 3

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricGLM-5.1Mistral Large 3
Intelligence
Overall indexpoints, 100 = reference group average, higher is better82.832.7
RankRank 56 of 95Rank 95 of 95
Price per 1M tokens
Inputwhat you send$1.40$0.50
Outputwhat the model writes$4.40$1.50
Speed
Tokens per second4657
Popularity
Popularitysearch, usage and mentions, 0 to 10062Rank 66 of 51148Rank 150 of 511
Technical
Context windowhow much text the model reads at once200,000 tokens≈ 300 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffn/an/a
ReleasedApr 7, 2026Dec 2, 2025
AvailabilityOpen SourceActive
Open weightsyesyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Is there a better choice?

Cheaper than Mistral Large 3Muse Ember 1.0

Overall index 110.5, rank 14$0.10 input and $0.50 output per 1M tokens

View profile
Best model in the overall indexClaude Fable 5.2

Overall index 130.9, rank 1$8 input and $40 output per 1M tokens

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: GLM-5.1B: Mistral Large 3

CorpFin v2Overall · higher is betterTest setup not documented as identicalGLM-5.1: 64.5%Mistral Large 3: 61.0%Vals AIAs of 08/12/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalGLM-5.1: 84.5%Mistral Large 3: 68.4%Vals AIAs of 09/01/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalGLM-5.1: 84.4%Mistral Large 3: 79.1%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalGLM-5.1: 81.4%Mistral Large 3: 55.3%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevOverall · higher is betterGLM-5.1: 1,508Mistral Large 3: 1,231LMArenaAs of 11/15/2026
LMArena Text, Style ControlOverall · higher is betterGLM-5.1: 1,465Mistral Large 3: 1,415LMArenaAs of 11/11/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalGLM-5.1: 86.9%Mistral Large 3: 79.8%Vals AIAs of 09/01/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalGLM-5.1: 76.4%Mistral Large 3: 41.4%Vals AIAs of 09/01/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalGLM-5.1: 71.2%Mistral Large 3: 73.1%Vals AIAs of 09/01/2026
CorpFin v2Exact Pages · higher is betterTest setup not documented as identicalGLM-5.1: 61.8%Mistral Large 3: 59.8%Vals AIAs of 08/12/2026
Show 54 more benchmarks
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalGLM-5.1: 85.8%Mistral Large 3: 64.1%Vals AIAs of 09/01/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalGLM-5.1: 89.6%Mistral Large 3: 81.0%Vals AIAs of 10/13/2026
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalGLM-5.1: 98.8%Mistral Large 3: 95.3%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevHTML development · higher is betterGLM-5.1: 1,510Mistral Large 3: 1,239LMArenaAs of 11/15/2026
LMArena Text, Style ControlBusiness, management and finance · higher is betterGLM-5.1: 1,467Mistral Large 3: 1,411LMArenaAs of 11/11/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalGLM-5.1: 93.7%Mistral Large 3: 88.6%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalGLM-5.1: 88.7%Mistral Large 3: 56.2%Vals AIAs of 09/01/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalGLM-5.1: 61.5%Mistral Large 3: 61.6%Vals AIAs of 09/01/2026
CorpFin v2Max Fitting Context · higher is betterTest setup not documented as identicalGLM-5.1: 66.3%Mistral Large 3: 63.8%Vals AIAs of 08/12/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalGLM-5.1: 83.2%Mistral Large 3: 72.7%Vals AIAs of 09/01/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalGLM-5.1: 81.7%Mistral Large 3: 76.6%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalGLM-5.1: 57.4%Mistral Large 3: 17.1%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevWeb development · higher is betterGLM-5.1: 1,508Mistral Large 3: 1,231LMArenaAs of 11/15/2026
LMArena Text, Style ControlChinese · higher is betterGLM-5.1: 1,514Mistral Large 3: 1,431LMArenaAs of 11/11/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalGLM-5.1: 91.1%Mistral Large 3: 84.7%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalGLM-5.1: 33.3%Mistral Large 3: 33.3%Vals AIAs of 09/01/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalGLM-5.1: 80.9%Mistral Large 3: 84.5%Vals AIAs of 09/01/2026
CorpFin v2Shared Max Context · higher is betterTest setup not documented as identicalGLM-5.1: 65.3%Mistral Large 3: 59.6%Vals AIAs of 08/12/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalGLM-5.1: 89%Mistral Large 3: 81%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalGLM-5.1: 88.0%Mistral Large 3: 53.5%Vals AIAs of 09/01/2026
LMArena Text, Style ControlCoding · higher is betterGLM-5.1: 1,512Mistral Large 3: 1,471LMArenaAs of 11/11/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalGLM-5.1: 91.8%Mistral Large 3: 85.0%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalGLM-5.1: 45.2%Mistral Large 3: 4.8%Vals AIAs of 09/01/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalGLM-5.1: 81.1%Mistral Large 3: 77.9%Vals AIAs of 10/13/2026
LMArena Text, Style ControlCreative writing · higher is betterGLM-5.1: 1,446Mistral Large 3: 1,375LMArenaAs of 11/11/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalGLM-5.1: 89.5%Mistral Large 3: 83.2%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalGLM-5.1: 72.8%Mistral Large 3: 36.4%Vals AIAs of 09/01/2026
LegalBenchRule Tasks · higher is betterTest setup not documented as identicalGLM-5.1: 80.6%Mistral Large 3: 79.1%Vals AIAs of 10/13/2026
LMArena Text, Style ControlEnglish · higher is betterGLM-5.1: 1,481Mistral Large 3: 1,427LMArenaAs of 11/11/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalGLM-5.1: 89.0%Mistral Large 3: 85.8%Vals AIAs of 09/01/2026
LMArena Text, Style ControlEntertainment, sports and media · higher is betterGLM-5.1: 1,442Mistral Large 3: 1,373LMArenaAs of 11/11/2026
MMLU ProEngineering · higher is betterTest setup not documented as identicalGLM-5.1: 84.0%Mistral Large 3: 74.9%Vals AIAs of 09/01/2026
LMArena Text, Style ControlExcluding ties · higher is betterGLM-5.1: 1,471Mistral Large 3: 1,402LMArenaAs of 11/11/2026
MMLU ProHealth · higher is betterTest setup not documented as identicalGLM-5.1: 81.5%Mistral Large 3: 77.3%Vals AIAs of 09/01/2026
LMArena Text, Style ControlExpert prompts · higher is betterGLM-5.1: 1,496Mistral Large 3: 1,428LMArenaAs of 11/11/2026
MMLU ProHistory · higher is betterTest setup not documented as identicalGLM-5.1: 78.4%Mistral Large 3: 70.9%Vals AIAs of 09/01/2026
LMArena Text, Style ControlFrench prompts · higher is betterGLM-5.1: 1,479Mistral Large 3: 1,432LMArenaAs of 11/11/2026
MMLU ProLaw · higher is betterTest setup not documented as identicalGLM-5.1: 74.0%Mistral Large 3: 56.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlGerman prompts · higher is betterGLM-5.1: 1,466Mistral Large 3: 1,411LMArenaAs of 11/11/2026
MMLU ProMath · higher is betterTest setup not documented as identicalGLM-5.1: 95.5%Mistral Large 3: 88.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlHard prompts · higher is betterGLM-5.1: 1,489Mistral Large 3: 1,433LMArenaAs of 11/11/2026
MMLU ProOthers · higher is betterTest setup not documented as identicalGLM-5.1: 84.5%Mistral Large 3: 79.2%Vals AIAs of 09/01/2026
LMArena Text, Style ControlHard prompts, English · higher is betterGLM-5.1: 1,499Mistral Large 3: 1,440LMArenaAs of 11/11/2026
MMLU ProPhilosophy · higher is betterTest setup not documented as identicalGLM-5.1: 83.9%Mistral Large 3: 76.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlInstruction following · higher is betterGLM-5.1: 1,461Mistral Large 3: 1,403LMArenaAs of 11/11/2026
MMLU ProPhysics · higher is betterTest setup not documented as identicalGLM-5.1: 92.3%Mistral Large 3: 86.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlJapanese prompts · higher is betterGLM-5.1: 1,441Mistral Large 3: 1,380LMArenaAs of 11/11/2026
MMLU ProPsychology · higher is betterTest setup not documented as identicalGLM-5.1: 87.2%Mistral Large 3: 80.6%Vals AIAs of 09/01/2026
LMArena Text, Style ControlKorean prompts · higher is betterGLM-5.1: 1,420Mistral Large 3: 1,364LMArenaAs of 11/11/2026
LMArena Text, Style ControlLegal and government · higher is betterGLM-5.1: 1,471Mistral Large 3: 1,422LMArenaAs of 11/11/2026
LMArena Text, Style ControlLife, physical and social science · higher is betterGLM-5.1: 1,488Mistral Large 3: 1,429LMArenaAs of 11/11/2026
LMArena Text, Style ControlLonger queries · higher is betterGLM-5.1: 1,480Mistral Large 3: 1,419LMArenaAs of 11/11/2026
LMArena Text, Style ControlMath · higher is betterGLM-5.1: 1,474Mistral Large 3: 1,402LMArenaAs of 11/11/2026
LMArena Text, Style ControlMathematical professions · higher is betterGLM-5.1: 1,476Mistral Large 3: 1,414LMArenaAs of 11/11/2026

More comparisons

Compare GLM-5.1 and Mistral Large 3 with the models people compare them with most often.

Compare another matchup