Skip to main content

OpenAIMistral AILLM matchup

GPT-5.4vs.Mistral Medium 3.5

Which one is better?

GPT-5.4 performs better than Mistral Medium 3.5, but costs 1.7 times (input) and 2 times (output) as much.

GPT-5.4 ahead
IntelligenceOverall index, 100 points = average
86.4

GPT-5.4

Rank 50

46.1

Mistral Medium 3.5

Rank 89

Mistral Medium 3.5 faster
SpeedTokens per second
64

GPT-5.4

105

Mistral Medium 3.5

Mistral Medium 3.5 cheaper
Price$ per 1M tokens
$5.63

GPT-5.4

$3

Mistral Medium 3.5

Popularity0 to 100
n/a

GPT-5.4

50

Mistral Medium 3.5

Rank 127 of 508

Above 272,000 tokens of context, GPT-5.4 costs more: $5 input and $22.50 output per 1M tokens.

Choose GPT-5.4 for

ReasoningFinanceMultimodalAgentsCodingHealth

No clear advantage for Mistral Medium 3.5.

Where is the difference?

Strengths at a glance

GPT-5.4Mistral Medium 3.5Median of all ranked models

45709512020CodingGPT-5.4ReasoningGPT-5.4AgentsGPT-5.4MultimodalGPT-5.4FinanceGPT-5.4HealthGPT-5.4
CodingGPT-5.4 ahead
GPT-5.485.0Rank 60
Mistral Medium 3.550.1Rank 97
Median of ranked models87.5

95 % range: GPT-5.4 75.3 to 94.6, Mistral Medium 3.5 43.3 to 56.8.

AreaGPT-5.4Mistral Medium 3.5

The same values and verdicts as the bars below. In the close-up the net starts at 20 points, just below the weaker model's lowest value; the reference group average is 100. Not in the net because a model has no own value there or the data are too thin: Mathematics, Knowledge, General, Legal.

GPT-5.4 is ahead in 6 of 10 areas, Mistral Medium 3.5 in none.

GPT-5.4 ahead: 6too little data: 4

Areas in the overall index
ReasoningGPT-5.4 +6087.9 to 28.2
MultimodalGPT-5.4 +4388.8 to 46.1
AgentsGPT-5.4 +3690.5 to 54.1
CodingGPT-5.4 +3585.0 to 50.1
Knowledgetoo little data87.0 to 36.0
Generaltoo little data86.1 to 54.7
Mathematicsonly Mistral Medium 3.5 has a score
Specialist fields
FinanceGPT-5.4 +4985.9 to 36.6
HealthGPT-5.4 +3180.4 to 49.5
Legaltoo little data83.9 to 53.0

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Show 1 more areas that do not count toward the overall index
Educationonly Mistral Medium 3.5 has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Which model for which task?

Everyday tasks, translated from the area values above. Each row names the values it rests on.

Writing and debugging codeGPT-5.4Coding 85.0 to 50.1
Maths and data analysisGPT-5.4Mathematics without a score for GPT-5.4, Reasoning 87.9 to 28.2
Facts and researchopenKnowledge 87.0 to 36.0 (too little data)
Agents and workflowsGPT-5.4Agents 90.5 to 54.1
Fast chat repliesMistral Medium 3.564 to 105 tokens per second
Many requests on a small budgetMistral Medium 3.5$5.63 to $3 per 1M tokens
Finance, legal and medical textsGPT-5.4Finance 85.9 to 36.6, Legal 83.9 to 53.0 (too little data), Health 80.4 to 49.5
Images, screenshots and PDFsGPT-5.4Multimodal 88.8 to 46.1

GPT-5.4 vs. Mistral Medium 3.5 in our own test

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Task origin: Simon Willison

GPT-5.4

GPT-5.4: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 117 s · $0.11

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
openai/gpt-5.4
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
7,339 tokens
Cost of the attempt
$0.1101
Response time
116.8 s
API model reported in response
openai/gpt-5.4
Pinned endpoint
OpenAI | openai/gpt-5.4-20260305
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: high

Mistral Medium 3.5

Mistral Medium 3.5: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 39 s · $0.06

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
mistralai/mistral-medium-3-5
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
8,128 tokens
Cost of the attempt
$0.0610
Response time
38.7 s
API model reported in response
mistralai/mistral-medium-3-5
Pinned endpoint
Mistral | mistralai/mistral-medium-3.5-20260430
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: high
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Prompt

Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.

GPT-5.4

Unavailable in this round

Mistral Medium 3.5

Mistral Medium 3.5: SVG short test

Oct 14, 2026 · $0.0039

Test details
Test run
Oct 14, 2026
Provider
mistral
API model
mistralai/mistral-medium-3-5
Output
502 tokens
Reasoning
API reports 0 reasoning tokens
Cost of the attempt
$0.0039
Test round
43b8c5c46830

GPT-5.4 and Mistral Medium 3.5 in the overall index

Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.

Overall index (Gradually Meta-Score v6)

20 of 95 models

Claude Fable 5.2max130.9
Gemini 4 Carbonhigh127.0
Claude Opus 5.5max125.7
Claude Fable 5.1max124.1
Claude Sonnet 5.5max121.9
Gemini 4 Argonhigh121.2
GPT-6 Astramax119.6
Muse Wonder Fullmax118.4
GPT-6.1 Solmax117.5
Claude Opus 5max117.3
Muse Wondermax113.7
Claude Fable 5max112.8
Kimi K3.1 Promax112.6
Muse Ember 1.0max110.5
GPT-5.6 Solmax109.3
GPT-6 Solmax108.4
Gemini 3.7 Flashhigh107.7
DeepSeek V4.1 Flash 1017max107.1
GPT-5.4xhigh86.4
Mistral Medium 3.5high46.1

Popularity compared

How often the models are searched for, used and mentioned, on a scale from 0 to 100.

GPT-5.4 has no popularity score yet.

Over time

Weekly values from October 18, 2026 to November 16, 2026

GPT-5.4Mistral Medium 3.5

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricGPT-5.4Mistral Medium 3.5
Intelligence
Overall indexpoints, 100 = reference group average, higher is better86.446.1
RankRank 50 of 95Rank 89 of 95
Price per 1M tokens
Inputwhat you send$2.50above 272,000 tokens: $5$1.50
Outputwhat the model writes$15above 272,000 tokens: $22.50$7.50
Cost per task (own tests)average of 3 original-protocol tasks both models passed (SVG short test not included)$0.19$0.087
Speed
Tokens per second64105
Popularity
Popularitysearch, usage and mentions, 0 to 100n/a50Rank 127 of 508
Technical
Context windowhow much text the model reads at once1.05 M tokens≈ 1,580 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffAug 31, 2025n/a
ReleasedMar 5, 2026Apr 28, 2026
AvailabilityActiveActive
Open weightsnoyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Is there a better choice?

Successor of GPT-5.4GPT-5.5

Overall index 101.4, rank 27$5 input and $30 output per 1M tokens

Mistral Medium 3.5 vs. GPT-5.5
Cheaper than Mistral Medium 3.5Muse Ember 1.0

Overall index 110.5, rank 14$0.10 input and $0.50 output per 1M tokens

View profile
Best model in the overall indexClaude Fable 5.2

Overall index 130.9, rank 1$8 input and $40 output per 1M tokens

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: GPT-5.4B: Mistral Medium 3.5

Code MigrationOverall · higher is betterTest setup not documented as identicalGPT-5.4: 35.0%Mistral Medium 3.5: 5.1%Vals AIAs of 10/29/2026
CorpFin v2Overall · higher is betterTest setup not documented as identicalGPT-5.4: 65.3%Mistral Medium 3.5: 58.8%Vals AIAs of 08/12/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalGPT-5.4: 91.7%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevOverall · higher is betterGPT-5.4: 1,400Mistral Medium 3.5: 1,263LMArenaAs of 11/15/2026
LMArena Text, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.4: 1,475Mistral Medium 3.5: 1,426LMArenaAs of 11/11/2026
LMArena Vision, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.4: 1,282Mistral Medium 3.5: 1,199LMArenaAs of 11/09/2026
MedCodeOverall · higher is betterTest setup not documented as identicalGPT-5.4: 41.3%Mistral Medium 3.5: 33.8%Vals AIAs of 10/29/2026
MedScribeOverall · higher is betterTest setup not documented as identicalGPT-5.4: 77.5%Mistral Medium 3.5: 67.7%Vals AIAs of 10/29/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalGPT-5.4: 87.5%Mistral Medium 3.5: 75.3%Vals AIAs of 09/01/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalGPT-5.4: 68.3%Mistral Medium 3.5: 28.9%Vals AIAs of 09/01/2026
Show 54 more benchmarks
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalGPT-5.4: 78.2%Mistral Medium 3.5: 66.4%Vals AIAs of 09/01/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalGPT-5.4: 74%Mistral Medium 3.5: 68%Vals AIAs of 09/01/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalGPT-5.4: 67.4%Mistral Medium 3.5: 2.9%Vals AIAs of 11/05/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalGPT-5.4: 23.8%Mistral Medium 3.5: 5.0%Vals AIAs of 10/29/2026
CorpFin v2Exact Pages · higher is betterTest setup not documented as identicalGPT-5.4: 64.1%Mistral Medium 3.5: 55.4%Vals AIAs of 08/12/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.4: 91.4%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevHTML development · higher is betterGPT-5.4: 1,423Mistral Medium 3.5: 1,309LMArenaAs of 11/15/2026
LMArena Text, Style ControlBusiness, management and finance · higher is betterTest setup not documented as identicalGPT-5.4: 1,482Mistral Medium 3.5: 1,431LMArenaAs of 11/11/2026
LMArena Vision, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.4: 1,317Mistral Medium 3.5: 1,217LMArenaAs of 11/09/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalGPT-5.4: 92.9%Mistral Medium 3.5: 64.4%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalGPT-5.4: 76.0%Mistral Medium 3.5: 11.9%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalGPT-5.4: 88.1%Mistral Medium 3.5: 79.4%Vals AIAs of 09/01/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalGPT-5.4: 64.9%Mistral Medium 3.5: 56.7%Vals AIAs of 09/01/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalGPT-5.4: 68.6%Mistral Medium 3.5: 5.5%Vals AIAs of 10/29/2026
CorpFin v2Max Fitting Context · higher is betterTest setup not documented as identicalGPT-5.4: 64.9%Mistral Medium 3.5: 61.1%Vals AIAs of 08/12/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.4: 91.9%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevReact development · higher is betterGPT-5.4: 1,388Mistral Medium 3.5: 1,252LMArenaAs of 11/15/2026
LMArena Text, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.4: 1,505Mistral Medium 3.5: 1,447LMArenaAs of 11/11/2026
LMArena Vision, Style ControlCreative writing with images · higher is betterTest setup not documented as identicalGPT-5.4: 1,264Mistral Medium 3.5: 1,196LMArenaAs of 11/09/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalGPT-5.4: 91.8%Mistral Medium 3.5: 64.4%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalGPT-5.4: 60.7%Mistral Medium 3.5: 45.9%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalGPT-5.4: 0.0%Mistral Medium 3.5: 33.3%Vals AIAs of 09/01/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalGPT-5.4: 83.0%Mistral Medium 3.5: 79.2%Vals AIAs of 09/01/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalGPT-5.4: 3.632 / 5Mistral Medium 3.5: 2.987 / 5Vals AIAs of 10/29/2026
CorpFin v2Shared Max Context · higher is betterTest setup not documented as identicalGPT-5.4: 66.8%Mistral Medium 3.5: 59.9%Vals AIAs of 08/12/2026
LMArena Code Arena WebDevWeb development · higher is betterGPT-5.4: 1,400Mistral Medium 3.5: 1,263LMArenaAs of 11/15/2026
LMArena Text, Style ControlCoding · higher is betterTest setup not documented as identicalGPT-5.4: 1,521Mistral Medium 3.5: 1,478LMArenaAs of 11/11/2026
LMArena Vision, Style ControlDiagram understanding · higher is betterTest setup not documented as identicalGPT-5.4: 1,319Mistral Medium 3.5: 1,242LMArenaAs of 11/09/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalGPT-5.4: 91.1%Mistral Medium 3.5: 73.1%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalGPT-5.4: 50.0%Mistral Medium 3.5: 33.3%Vals AIAs of 09/01/2026
LMArena Text, Style ControlCreative writing · higher is betterTest setup not documented as identicalGPT-5.4: 1,440Mistral Medium 3.5: 1,399LMArenaAs of 11/11/2026
LMArena Vision, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.4: 1,279Mistral Medium 3.5: 1,218LMArenaAs of 11/09/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalGPT-5.4: 89.8%Mistral Medium 3.5: 82.9%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalGPT-5.4: 76.2%Mistral Medium 3.5: 62.5%Vals AIAs of 09/01/2026
LMArena Text, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.4: 1,476Mistral Medium 3.5: 1,443LMArenaAs of 11/11/2026
LMArena Vision, Style ControlHomework · higher is betterTest setup not documented as identicalGPT-5.4: 1,330Mistral Medium 3.5: 1,216LMArenaAs of 11/09/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalGPT-5.4: 89.7%Mistral Medium 3.5: 78.2%Vals AIAs of 09/01/2026
LMArena Text, Style ControlEntertainment, sports and media · higher is betterTest setup not documented as identicalGPT-5.4: 1,441Mistral Medium 3.5: 1,397LMArenaAs of 11/11/2026
LMArena Vision, Style ControlHumor · higher is betterTest setup not documented as identicalGPT-5.4: 1,267Mistral Medium 3.5: 1,197LMArenaAs of 11/09/2026
MMLU ProEngineering · higher is betterTest setup not documented as identicalGPT-5.4: 85.2%Mistral Medium 3.5: 78.2%Vals AIAs of 09/01/2026
LMArena Text, Style ControlExcluding ties · higher is betterTest setup not documented as identicalGPT-5.4: 1,484Mistral Medium 3.5: 1,420LMArenaAs of 11/11/2026
LMArena Vision, Style ControlOptical character recognition · higher is betterTest setup not documented as identicalGPT-5.4: 1,297Mistral Medium 3.5: 1,215LMArenaAs of 11/09/2026
MMLU ProHealth · higher is betterTest setup not documented as identicalGPT-5.4: 82.4%Mistral Medium 3.5: 75.3%Vals AIAs of 09/01/2026
LMArena Text, Style ControlExpert prompts · higher is betterTest setup not documented as identicalGPT-5.4: 1,514Mistral Medium 3.5: 1,434LMArenaAs of 11/11/2026
MMLU ProHistory · higher is betterTest setup not documented as identicalGPT-5.4: 79.3%Mistral Medium 3.5: 69.6%Vals AIAs of 09/01/2026
LMArena Text, Style ControlFrench prompts · higher is betterTest setup not documented as identicalGPT-5.4: 1,501Mistral Medium 3.5: 1,436LMArenaAs of 11/11/2026
MMLU ProLaw · higher is betterTest setup not documented as identicalGPT-5.4: 75.5%Mistral Medium 3.5: 56.9%Vals AIAs of 09/01/2026
LMArena Text, Style ControlGerman prompts · higher is betterTest setup not documented as identicalGPT-5.4: 1,476Mistral Medium 3.5: 1,453LMArenaAs of 11/11/2026
MMLU ProMath · higher is betterTest setup not documented as identicalGPT-5.4: 94.7%Mistral Medium 3.5: 91.0%Vals AIAs of 09/01/2026
LMArena Text, Style ControlHard prompts · higher is betterTest setup not documented as identicalGPT-5.4: 1,496Mistral Medium 3.5: 1,445LMArenaAs of 11/11/2026
MMLU ProOthers · higher is betterTest setup not documented as identicalGPT-5.4: 86.5%Mistral Medium 3.5: 78.1%Vals AIAs of 09/01/2026
LMArena Text, Style ControlHard prompts, English · higher is betterTest setup not documented as identicalGPT-5.4: 1,493Mistral Medium 3.5: 1,457LMArenaAs of 11/11/2026
MMLU ProPhilosophy · higher is betterTest setup not documented as identicalGPT-5.4: 87.0%Mistral Medium 3.5: 73.1%Vals AIAs of 09/01/2026
LMArena Text, Style ControlInstruction following · higher is betterTest setup not documented as identicalGPT-5.4: 1,471Mistral Medium 3.5: 1,423LMArenaAs of 11/11/2026

More comparisons

Compare GPT-5.4 and Mistral Medium 3.5 with the models people compare them with most often.

Compare another matchup

The most popular comparisons

  1. 1GPT-6 Luna vs. GPT-5.4
  2. 2GPT-5.4 vs. GLM-5.3-Flash
  3. 3GPT-6 Sol vs. GPT-5.4
  4. 4DeepSeek-V4.1-Flash vs. Mistral Medium 3.5
  5. 5Claude Opus 5.5 vs. Mistral Medium 3.5
  6. 6Qwen 3.8 27B vs. Mistral Medium 3.5
  7. 7GLM-5.2 vs. Mistral Medium 3.5
  8. 8GPT-6 Luna vs. Mistral Medium 3.5
  9. 9Claude Sonnet 5.5 vs. Mistral Medium 3.5
Show all 24 comparisons
  1. 10DeepSeek V4.1 Flash 1017 vs. Mistral Medium 3.5
  2. 11GPT-5.6 Luna vs. GPT-5.4
  3. 12GPT-5.4 vs. GLM-5.3
  4. 13Claude Sonnet 5.5 vs. GPT-5.4
  5. 14GPT-6 Astra vs. GPT-5.4
  6. 15DeepSeek-V4-Pro vs. Mistral Medium 3.5
  7. 16Claude Opus 5.5 vs. GPT-5.4
  8. 17GPT-5.6 Terra vs. GPT-5.4
  9. 18GPT-5.6 Sol vs. GPT-5.4
  10. 19Claude Sonnet 4.5 vs. Mistral Medium 3.5
  11. 20Mistral Large 4 vs. Mistral Medium 3.5
  12. 21Claude Fable 5 vs. GPT-5.4
  13. 22GPT-6.1 Sol vs. GPT-5.4
  14. 23GPT-6.1 Terra vs. GPT-5.4
  15. 24Gemini 4 Argon vs. Mistral Medium 3.5