Skip to main content

OpenAIMistral AILLM matchup

GPT-5.4 minivs.Mistral Medium 3.5

Which one is better?

GPT-5.4 mini performs better than Mistral Medium 3.5 and is cheaper: Mistral Medium 3.5 costs 2 times (input) and 1.7 times (output) as much.

GPT-5.4 mini ahead
IntelligenceOverall index, 100 points = average
75.1

GPT-5.4 mini

Rank 62

46.1

Mistral Medium 3.5

Rank 89

about as fast
SpeedTokens per second
97

GPT-5.4 mini

105

Mistral Medium 3.5

GPT-5.4 mini cheaper
Price$ per 1M tokens
$1.69

GPT-5.4 mini

$3

Mistral Medium 3.5

Popularity0 to 100
n/a

GPT-5.4 mini

50

Mistral Medium 3.5

Rank 127 of 508

Choose GPT-5.4 mini for

FinanceMultimodalCodingAgentsGeneral

No clear advantage for Mistral Medium 3.5.

Where is the difference?

Strengths at a glance

GPT-5.4 miniMistral Medium 3.5Median of all ranked models

50709011030CodingGPT-5.4 miniAgentsGPT-5.4 miniGeneralGPT-5.4 miniMultimodalGPT-5.4 miniFinanceGPT-5.4 mini
CodingGPT-5.4 mini ahead
GPT-5.4 mini75.7Rank 71
Mistral Medium 3.550.1Rank 97
Median of ranked models87.5

95 % range: GPT-5.4 mini 70.9 to 80.5, Mistral Medium 3.5 43.3 to 56.8.

AreaGPT-5.4 miniMistral Medium 3.5

The same values and verdicts as the bars below. In the close-up the net starts at 30 points, just below the weaker model's lowest value; the reference group average is 100. Not in the net because a model has no own value there or the data are too thin: Reasoning, Mathematics, Knowledge, Legal, Health.

GPT-5.4 mini is ahead in 5 of 10 areas, Mistral Medium 3.5 in none.

GPT-5.4 mini ahead: 5too little data: 5

Areas in the overall index
MultimodalGPT-5.4 mini +2975.1 to 46.1
CodingGPT-5.4 mini +2675.7 to 50.1
AgentsGPT-5.4 mini +2578.7 to 54.1
GeneralGPT-5.4 mini +2579.3 to 54.7
Reasoningtoo little data72.9 to 28.2
Knowledgetoo little data73.8 to 36.0
Mathematicsonly Mistral Medium 3.5 has a score
Specialist fields
FinanceGPT-5.4 mini +3975.1 to 36.6
Legaltoo little data71.3 to 53.0
Healthonly Mistral Medium 3.5 has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Show 1 more areas that do not count toward the overall index
Educationonly Mistral Medium 3.5 has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Which model for which task?

Everyday tasks, translated from the area values above. Each row names the values it rests on.

Writing and debugging codeGPT-5.4 miniCoding 75.7 to 50.1
Maths and data analysisopenMathematics without a score for GPT-5.4 mini, Reasoning 72.9 to 28.2 (too little data)
Facts and researchopenKnowledge 73.8 to 36.0 (too little data)
Agents and workflowsGPT-5.4 miniAgents 78.7 to 54.1
Fast chat repliesabout the same97 to 105 tokens per second
Many requests on a small budgetGPT-5.4 mini$1.69 to $3 per 1M tokens
Finance, legal and medical textsGPT-5.4 miniFinance 75.1 to 36.6, Legal 71.3 to 53.0 (too little data), Health without a score for GPT-5.4 mini
Images, screenshots and PDFsGPT-5.4 miniMultimodal 75.1 to 46.1

GPT-5.4 mini vs. Mistral Medium 3.5 in our own test

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Task origin: Simon Willison

GPT-5.4 mini

GPT-5.4 mini: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 2, 2026 · 14 s · $0.01

Test details
Run date
Oct 2, 2026
API provider
openrouter
Requested API model
openai/gpt-5.4-mini
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
3,142 tokens
Cost of the attempt
$0.0142
Response time
13.5 s
API model reported in response
openai/gpt-5.4-mini
Pinned endpoint
OpenAI | openai/gpt-5.4-mini-20260317
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (2)

  • Oct 1, 2026API request failedReasoning setting: high
  • Sep 7, 2026API request failedReasoning setting: high

Mistral Medium 3.5

Mistral Medium 3.5: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 39 s · $0.06

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
mistralai/mistral-medium-3-5
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
8,128 tokens
Cost of the attempt
$0.0610
Response time
38.7 s
API model reported in response
mistralai/mistral-medium-3-5
Pinned endpoint
Mistral | mistralai/mistral-medium-3.5-20260430
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: high
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Prompt

Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.

GPT-5.4 mini

Unavailable in this round

Mistral Medium 3.5

Mistral Medium 3.5: SVG short test

Oct 14, 2026 · $0.0039

Test details
Test run
Oct 14, 2026
Provider
mistral
API model
mistralai/mistral-medium-3-5
Output
502 tokens
Reasoning
API reports 0 reasoning tokens
Cost of the attempt
$0.0039
Test round
43b8c5c46830

GPT-5.4 mini and Mistral Medium 3.5 in the overall index

Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.

Overall index (Gradually Meta-Score v6)

20 of 95 models

Claude Fable 5.2max130.9
Gemini 4 Carbonhigh127.0
Claude Opus 5.5max125.7
Claude Fable 5.1max124.1
Claude Sonnet 5.5max121.9
Gemini 4 Argonhigh121.2
GPT-6 Astramax119.6
Muse Wonder Fullmax118.4
GPT-6.1 Solmax117.5
Claude Opus 5max117.3
Muse Wondermax113.7
Claude Fable 5max112.8
Kimi K3.1 Promax112.6
Muse Ember 1.0max110.5
GPT-5.6 Solmax109.3
GPT-6 Solmax108.4
Gemini 3.7 Flashhigh107.7
DeepSeek V4.1 Flash 1017max107.1
GPT-5.4 minixhigh75.1
Mistral Medium 3.5high46.1

Popularity compared

How often the models are searched for, used and mentioned, on a scale from 0 to 100.

GPT-5.4 mini has no popularity score yet.

Over time

Weekly values from October 18, 2026 to November 16, 2026

GPT-5.4 miniMistral Medium 3.5

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricGPT-5.4 miniMistral Medium 3.5
Intelligence
Overall indexpoints, 100 = reference group average, higher is better75.146.1
RankRank 62 of 95Rank 89 of 95
Price per 1M tokens
Inputwhat you send$0.75$1.50
Outputwhat the model writes$4.50$7.50
Cost per task (own tests)average of 1 original-protocol task both models passed (SVG short test not included)$0.014$0.061
Speed
Tokens per second97105
Popularity
Popularitysearch, usage and mentions, 0 to 100n/a50Rank 127 of 508
Technical
Context windowhow much text the model reads at once400,000 tokens≈ 600 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffAug 31, 2025n/a
ReleasedMar 17, 2026Apr 28, 2026
AvailabilityActiveActive
Open weightsnoyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Is there a better choice?

Cheaper than GPT-5.4 miniMuse Ember 1.0

Overall index 110.5, rank 14$0.10 input and $0.50 output per 1M tokens

View profile
Best model in the overall indexClaude Fable 5.2

Overall index 130.9, rank 1$8 input and $40 output per 1M tokens

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: GPT-5.4 miniB: Mistral Medium 3.5

Code MigrationOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 12.9%Mistral Medium 3.5: 5.1%Vals AIAs of 10/29/2026
CorpFin v2Overall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 60.9%Mistral Medium 3.5: 58.8%Vals AIAs of 08/12/2026
EMBOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 45.4%Mistral Medium 3.5: 11.2%Vals AIAs of 10/20/2026
Finance Agent (v2)Overall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 45.4%Mistral Medium 3.5: 32.1%Vals AIAs of 10/29/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 83.1%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalGPT-5.4 mini: 12.5%Mistral Medium 3.5: 9.1%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,398Mistral Medium 3.5: 1,263LMArenaAs of 11/15/2026
LMArena Text, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,447Mistral Medium 3.5: 1,426LMArenaAs of 11/11/2026
LMArena Vision, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,250Mistral Medium 3.5: 1,199LMArenaAs of 11/09/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 84.6%Mistral Medium 3.5: 75.3%Vals AIAs of 09/01/2026
Show 54 more benchmarks
MortgageTaxOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 63.5%Mistral Medium 3.5: 28.9%Vals AIAs of 09/01/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 73.0%Mistral Medium 3.5: 66.4%Vals AIAs of 09/01/2026
Taste-BenchOverall · higher is betterGPT-5.4 mini: 40.1%Mistral Medium 3.5: 37.7%Taste-Bench paperAs of 09/23/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 8.8%Mistral Medium 3.5: 4.5%Vals AIAs of 11/05/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 71.2%Mistral Medium 3.5: 68.0%Vals AIAs of 09/01/2026
Vals Multimodal IndexOverall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 54.2%Mistral Medium 3.5: 34.8%Vals AIAs of 08/11/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalGPT-5.4 mini: 48.0%Mistral Medium 3.5: 2.9%Vals AIAs of 11/05/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalGPT-5.4 mini: 8.2%Mistral Medium 3.5: 5.0%Vals AIAs of 10/29/2026
CorpFin v2Exact Pages · higher is betterTest setup not documented as identicalGPT-5.4 mini: 61.5%Mistral Medium 3.5: 55.4%Vals AIAs of 08/12/2026
EMBComps · higher is betterTest setup not documented as identicalGPT-5.4 mini: 40.5%Mistral Medium 3.5: 18.1%Vals AIAs of 10/20/2026
Finance Agent (v2)Adjustments · higher is betterTest setup not documented as identicalGPT-5.4 mini: 45.4%Mistral Medium 3.5: 27.3%Vals AIAs of 10/29/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.4 mini: 84.8%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalGPT-5.4 mini: 15.2%Mistral Medium 3.5: 7.6%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevHTML development · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,420Mistral Medium 3.5: 1,309LMArenaAs of 11/15/2026
LMArena Text, Style ControlBusiness, management and finance · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,459Mistral Medium 3.5: 1,431LMArenaAs of 11/11/2026
LMArena Vision, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,285Mistral Medium 3.5: 1,217LMArenaAs of 11/09/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalGPT-5.4 mini: 91.4%Mistral Medium 3.5: 64.4%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalGPT-5.4 mini: 79.4%Mistral Medium 3.5: 11.9%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalGPT-5.4 mini: 85.6%Mistral Medium 3.5: 79.4%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalGPT-5.4 mini: 3.3%Mistral Medium 3.5: 3.3%Vals AIAs of 11/05/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalGPT-5.4 mini: 63.0%Mistral Medium 3.5: 56.7%Vals AIAs of 09/01/2026
Vals Multimodal IndexCorpFin v2 · higher is betterTest setup not documented as identicalGPT-5.4 mini: 60.3%Mistral Medium 3.5: 59.9%Vals AIAs of 08/11/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalGPT-5.4 mini: 27.1%Mistral Medium 3.5: 5.5%Vals AIAs of 10/29/2026
CorpFin v2Max Fitting Context · higher is betterTest setup not documented as identicalGPT-5.4 mini: 61.0%Mistral Medium 3.5: 61.1%Vals AIAs of 08/12/2026
EMBDataroom · higher is betterTest setup not documented as identicalGPT-5.4 mini: 48.3%Mistral Medium 3.5: 13.4%Vals AIAs of 10/20/2026
Finance Agent (v2)All-Pass · higher is betterTest setup not documented as identicalGPT-5.4 mini: 32.4%Mistral Medium 3.5: 21.6%Vals AIAs of 10/29/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.4 mini: 81.3%Mistral Medium 3.5: 34.8%Vals AIAs of 09/01/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit (weighted pass) · higher is betterTest setup not documented as identicalGPT-5.4 mini: 69.7%Mistral Medium 3.5: 67.5%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevReact development · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,386Mistral Medium 3.5: 1,252LMArenaAs of 11/15/2026
LMArena Text, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,473Mistral Medium 3.5: 1,447LMArenaAs of 11/11/2026
LMArena Vision, Style ControlCreative writing with images · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,225Mistral Medium 3.5: 1,196LMArenaAs of 11/09/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalGPT-5.4 mini: 89.7%Mistral Medium 3.5: 64.4%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalGPT-5.4 mini: 47.6%Mistral Medium 3.5: 45.9%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalGPT-5.4 mini: 0.0%Mistral Medium 3.5: 33.3%Vals AIAs of 09/01/2026
Tax Agent BenchControversy & Precedence Analysis (weighted pass) · higher is betterTest setup not documented as identicalGPT-5.4 mini: 32.2%Mistral Medium 3.5: 18.4%Vals AIAs of 11/05/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalGPT-5.4 mini: 79.4%Mistral Medium 3.5: 79.2%Vals AIAs of 09/01/2026
Vals Multimodal IndexFinance Agent v2 · higher is betterTest setup not documented as identicalGPT-5.4 mini: 45.4%Mistral Medium 3.5: 31.5%Vals AIAs of 08/11/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalGPT-5.4 mini: 3.053 / 5Mistral Medium 3.5: 2.987 / 5Vals AIAs of 10/29/2026
CorpFin v2Shared Max Context · higher is betterTest setup not documented as identicalGPT-5.4 mini: 60.3%Mistral Medium 3.5: 59.9%Vals AIAs of 08/12/2026
EMBDCF · higher is betterTest setup not documented as identicalGPT-5.4 mini: 40.6%Mistral Medium 3.5: 2.2%Vals AIAs of 10/20/2026
Finance Agent (v2)Comparables · higher is betterTest setup not documented as identicalGPT-5.4 mini: 40.3%Mistral Medium 3.5: 31.5%Vals AIAs of 10/29/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalGPT-5.4 mini: 11.6%Mistral Medium 3.5: 9.3%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevWeb development · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,398Mistral Medium 3.5: 1,263LMArenaAs of 11/15/2026
LMArena Text, Style ControlCoding · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,495Mistral Medium 3.5: 1,478LMArenaAs of 11/11/2026
LMArena Vision, Style ControlDiagram understanding · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,283Mistral Medium 3.5: 1,242LMArenaAs of 11/09/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalGPT-5.4 mini: 89.1%Mistral Medium 3.5: 73.1%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalGPT-5.4 mini: 33.3%Mistral Medium 3.5: 33.3%Vals AIAs of 09/01/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalGPT-5.4 mini: 10.0%Mistral Medium 3.5: 6.5%Vals AIAs of 11/05/2026
Vals Multimodal IndexMortgage Tax · higher is betterTest setup not documented as identicalGPT-5.4 mini: 63.5%Mistral Medium 3.5: 28.9%Vals AIAs of 08/11/2026
EMBLBO · higher is betterTest setup not documented as identicalGPT-5.4 mini: 41.6%Mistral Medium 3.5: 9.6%Vals AIAs of 10/20/2026
Finance Agent (v2)Disclosure Analysis · higher is betterTest setup not documented as identicalGPT-5.4 mini: 48.3%Mistral Medium 3.5: 40.2%Vals AIAs of 10/29/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit (weighted pass) · higher is betterTest setup not documented as identicalGPT-5.4 mini: 71.2%Mistral Medium 3.5: 71.3%Vals AIAs of 11/05/2026
LMArena Text, Style ControlCreative writing · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,401Mistral Medium 3.5: 1,399LMArenaAs of 11/11/2026
LMArena Vision, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.4 mini: 1,247Mistral Medium 3.5: 1,218LMArenaAs of 11/09/2026

More comparisons

Compare GPT-5.4 mini and Mistral Medium 3.5 with the models people compare them with most often.

Compare another matchup