Skip to main content

OpenAIMistral AILLM matchup

GPT-5.6 Solvs.Mistral Large 3

Which one is better?

GPT-5.6 Sol performs better than Mistral Large 3, but costs 8 times (input) and 13.3 times (output) as much.

GPT-5.6 Sol ahead
IntelligenceOverall index, 100 points = average
109.3

GPT-5.6 Sol

Rank 15

32.7

Mistral Large 3

Rank 95

about as fast
SpeedTokens per second
66

GPT-5.6 Sol

60

Mistral Large 3

Mistral Large 3 cheaper
Price$ per 1M tokens
$8

GPT-5.6 Sol

$0.75

Mistral Large 3

GPT-5.6 Sol more popular
Popularity0 to 100
78

GPT-5.6 Sol

Rank 22 of 508

48

Mistral Large 3

Rank 145 of 508

Above 272,000 tokens of context, GPT-5.6 Sol costs more: $8 input and $30 output per 1M tokens.

Choose GPT-5.6 Sol for

CodingGeneralMultimodalFinance

No clear advantage for Mistral Large 3.

Where is the difference?

Strengths at a glance

GPT-5.6 SolMistral Large 3Median of all ranked models

507510012525CodingGPT-5.6 SolGeneralGPT-5.6 SolMultimodalGPT-5.6 SolFinanceGPT-5.6 Sol
CodingGPT-5.6 Sol ahead
GPT-5.6 Sol111.9Rank 16
Mistral Large 331.9Rank 113
Median of ranked models87.5

95 % range: GPT-5.6 Sol 107.2 to 116.7, Mistral Large 3 19.3 to 44.5.

AreaGPT-5.6 SolMistral Large 3

The same values and verdicts as the bars below. In the close-up the net starts at 25 points, just below the weaker model's lowest value; the reference group average is 100. Not in the net because a model has no own value there or the data are too thin: Reasoning, Mathematics, Knowledge, Agents, Legal, Health.

GPT-5.6 Sol is ahead in 4 of 10 areas, Mistral Large 3 in none.

GPT-5.6 Sol ahead: 4too little data: 6

Areas in the overall index
CodingGPT-5.6 Sol +80111.9 to 31.9
GeneralGPT-5.6 Sol +79112.8 to 33.4
MultimodalGPT-5.6 Sol +79111.5 to 32.8
Mathematicstoo little data108.1 to 22.2
Reasoningtoo little data116.7 to 34.3
Agentstoo little data105.9 to 34.3
Knowledgetoo little data106.6 to 38.4
Specialist fields
FinanceGPT-5.6 Sol +62103.6 to 41.3
Healthtoo little data101.1 to 30.9
Legaltoo little data107.1 to 39.7

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Show 3 more areas that do not count toward the overall index
Cybersecurityonly GPT-5.6 Sol has a score
Searchonly GPT-5.6 Sol has a score
Productivityonly GPT-5.6 Sol has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Which model for which task?

Everyday tasks, translated from the area values above. Each row names the values it rests on.

Writing and debugging codeGPT-5.6 SolCoding 111.9 to 31.9
Maths and data analysisopenMathematics 108.1 to 22.2 (too little data), Reasoning 116.7 to 34.3 (too little data)
Facts and researchopenKnowledge 106.6 to 38.4 (too little data), Search without a score for Mistral Large 3
Agents and workflowsopenAgents 105.9 to 34.3 (too little data)
Fast chat repliesabout the same66 to 60 tokens per second
Security analysisopenCybersecurity without a score for Mistral Large 3
Many requests on a small budgetMistral Large 3$8 to $0.75 per 1M tokens
Finance, legal and medical textsGPT-5.6 SolFinance 103.6 to 41.3, Legal 107.1 to 39.7 (too little data), Health 101.1 to 30.9 (too little data)
Images, screenshots and PDFsGPT-5.6 SolMultimodal 111.5 to 32.8

GPT-5.6 Sol vs. Mistral Large 3 in our own test

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Task origin: Simon Willison

GPT-5.6 Sol

GPT-5.6 Sol: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 59 s · $0.05

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
openai/gpt-5.6-sol
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
4,633 tokens
Cost of the attempt
$0.0464
Response time
58.7 s
API model reported in response
openai/gpt-5.6-sol
Pinned endpoint
OpenAI | openai/gpt-5.6-sol-20260709
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: high

Mistral Large 3

Mistral Large 3: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 14 s · $0.0022

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
mistralai/mistral-large-2512
Reasoning setting
not specified
Token limit including reasoning
8,192 tokens
Output tokens
1,451 tokens
Cost of the attempt
$0.0022
Response time
14.2 s
API model reported in response
mistralai/mistral-large-2512
Pinned endpoint
Mistral | mistralai/mistral-large-2512
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Reasoning (model default)
no reasoning mode Source

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: not specified
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Prompt

Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.

GPT-5.6 Sol

Unavailable in this round

Mistral Large 3

API request failed. The model was not evaluated.

GPT-5.6 Sol and Mistral Large 3 in the overall index

Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.

Overall index (Gradually Meta-Score v6)

20 of 95 models

Claude Fable 5.2max130.9
Gemini 4 Carbonhigh127.0
Claude Opus 5.5max125.7
Claude Fable 5.1max124.1
Claude Sonnet 5.5max121.9
Gemini 4 Argonhigh121.2
GPT-6 Astramax119.6
Muse Wonder Fullmax118.4
GPT-6.1 Solmax117.5
Claude Opus 5max117.3
Muse Wondermax113.7
Claude Fable 5max112.8
Kimi K3.1 Promax112.6
Muse Ember 1.0max110.5
GPT-5.6 Solmax109.3
GPT-6 Solmax108.4
Gemini 3.7 Flashhigh107.7
DeepSeek V4.1 Flash 1017max107.1
GPT-6.1 Terramax106.5
Mistral Large 3none32.7

Popularity compared

How often the models are searched for, used and mentioned, on a scale from 0 to 100.

GPT-5.6 Sol is more popular than Mistral Large 3: 78 to 48 out of 100.

Over time

Weekly values from October 18, 2026 to November 16, 2026

GPT-5.6 SolMistral Large 3

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricGPT-5.6 SolMistral Large 3
Intelligence
Overall indexpoints, 100 = reference group average, higher is better109.332.7
RankRank 15 of 95Rank 95 of 95
Price per 1M tokens
Inputwhat you send$4above 272,000 tokens: $8$0.50
Outputwhat the model writes$20above 272,000 tokens: $30$1.50
Cost per task (own tests)average of 1 original-protocol task both models passed (SVG short test not included)$0.046$0.002
Speed
Tokens per second6660
Popularity
Popularitysearch, usage and mentions, 0 to 10078Rank 22 of 50848Rank 145 of 508
Technical
Context windowhow much text the model reads at once1.05 M tokens≈ 1,580 A4 pages262,144 tokens≈ 390 A4 pages
Knowledge cutoffFeb 16, 2026n/a
ReleasedJul 9, 2026Dec 2, 2025
AvailabilityActiveActive
Open weightsnoyes

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Is there a better choice?

Successor of GPT-5.6 SolGPT-6 Astra

Overall index 119.6, rank 7$10 input and $50 output per 1M tokens

Mistral Large 3 vs. GPT-6 Astra
Cheaper than Mistral Large 3Muse Ember 1.0

Overall index 110.5, rank 14$0.10 input and $0.50 output per 1M tokens

View profile
Best model in the overall indexClaude Fable 5.2

Overall index 130.9, rank 1$8 input and $40 output per 1M tokens

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: GPT-5.6 SolB: Mistral Large 3

CorpFin v2Overall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 64.4%Mistral Large 3: 61.0%Vals AIAs of 08/12/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 95.2%Mistral Large 3: 68.4%Vals AIAs of 09/01/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 87.0%Mistral Large 3: 79.1%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 82.6%Mistral Large 3: 55.3%Vals AIAs of 09/01/2026
LMArena Text, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,485Mistral Large 3: 1,415LMArenaAs of 11/11/2026
LMArena Vision, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,288Mistral Large 3: 1,200LMArenaAs of 11/09/2026
MMLU ProOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 89.1%Mistral Large 3: 79.8%Vals AIAs of 09/01/2026
MMMU ProOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 88.8%Mistral Large 3: 66.2%Vals AIAs of 09/01/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 67.3%Mistral Large 3: 52.1%Vals AIAs of 09/01/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 96.2%Mistral Large 3: 41.4%Vals AIAs of 09/01/2026
Show 54 more benchmarks
TaxEval v2Overall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 74.8%Mistral Large 3: 73.1%Vals AIAs of 09/01/2026
CorpFin v2Exact Pages · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 61.5%Mistral Large 3: 59.8%Vals AIAs of 08/12/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 94.9%Mistral Large 3: 64.1%Vals AIAs of 09/01/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 90.5%Mistral Large 3: 81.0%Vals AIAs of 10/13/2026
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 98.1%Mistral Large 3: 95.3%Vals AIAs of 09/01/2026
LMArena Text, Style ControlBusiness, management and finance · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,488Mistral Large 3: 1,411LMArenaAs of 11/11/2026
LMArena Vision, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,304Mistral Large 3: 1,219LMArenaAs of 11/09/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 94.6%Mistral Large 3: 88.6%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 75.1%Mistral Large 3: 50.0%Vals AIAs of 09/01/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 97.4%Mistral Large 3: 56.2%Vals AIAs of 09/01/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 65.0%Mistral Large 3: 61.6%Vals AIAs of 09/01/2026
CorpFin v2Max Fitting Context · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 65.2%Mistral Large 3: 63.8%Vals AIAs of 08/12/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 95.5%Mistral Large 3: 72.7%Vals AIAs of 09/01/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 84.4%Mistral Large 3: 76.6%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 67.4%Mistral Large 3: 17.1%Vals AIAs of 09/01/2026
LMArena Text, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,540Mistral Large 3: 1,431LMArenaAs of 11/11/2026
LMArena Vision, Style ControlCreative writing with images · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,291Mistral Large 3: 1,198LMArenaAs of 11/09/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 93.3%Mistral Large 3: 84.7%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 59.5%Mistral Large 3: 54.2%Vals AIAs of 09/01/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 100.0%Mistral Large 3: 33.3%Vals AIAs of 09/01/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 84.5%Mistral Large 3: 84.5%Vals AIAs of 09/01/2026
CorpFin v2Shared Max Context · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 66.4%Mistral Large 3: 59.6%Vals AIAs of 08/12/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 91.4%Mistral Large 3: 81.0%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 82.2%Mistral Large 3: 53.5%Vals AIAs of 09/01/2026
LMArena Text, Style ControlCoding · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,533Mistral Large 3: 1,471LMArenaAs of 11/11/2026
LMArena Vision, Style ControlDiagram understanding · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,319Mistral Large 3: 1,233LMArenaAs of 11/09/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 92%Mistral Large 3: 85%Vals AIAs of 09/01/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 97.6%Mistral Large 3: 4.8%Vals AIAs of 09/01/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 82.1%Mistral Large 3: 77.9%Vals AIAs of 10/13/2026
LMArena Text, Style ControlCreative writing · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,471Mistral Large 3: 1,375LMArenaAs of 11/11/2026
LMArena Vision, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,288Mistral Large 3: 1,208LMArenaAs of 11/09/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 90.7%Mistral Large 3: 83.2%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 95.0%Mistral Large 3: 36.4%Vals AIAs of 09/01/2026
LegalBenchRule Tasks · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 86.4%Mistral Large 3: 79.1%Vals AIAs of 10/13/2026
LMArena Text, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,490Mistral Large 3: 1,427LMArenaAs of 11/11/2026
LMArena Vision, Style ControlHomework · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,316Mistral Large 3: 1,203LMArenaAs of 11/09/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 90.6%Mistral Large 3: 85.8%Vals AIAs of 09/01/2026
LMArena Text, Style ControlEntertainment, sports and media · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,470Mistral Large 3: 1,373LMArenaAs of 11/11/2026
LMArena Vision, Style ControlHumor · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,258Mistral Large 3: 1,186LMArenaAs of 11/09/2026
MMLU ProEngineering · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 87.8%Mistral Large 3: 74.9%Vals AIAs of 09/01/2026
LMArena Text, Style ControlExcluding ties · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,500Mistral Large 3: 1,402LMArenaAs of 11/11/2026
LMArena Vision, Style ControlOptical character recognition · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,298Mistral Large 3: 1,214LMArenaAs of 11/09/2026
MMLU ProHealth · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 84.1%Mistral Large 3: 77.3%Vals AIAs of 09/01/2026
LMArena Text, Style ControlExpert prompts · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,532Mistral Large 3: 1,428LMArenaAs of 11/11/2026
MMLU ProHistory · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 81.9%Mistral Large 3: 70.9%Vals AIAs of 09/01/2026
LMArena Text, Style ControlFrench prompts · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,509Mistral Large 3: 1,432LMArenaAs of 11/11/2026
MMLU ProLaw · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 79.1%Mistral Large 3: 56.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlGerman prompts · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,503Mistral Large 3: 1,411LMArenaAs of 11/11/2026
MMLU ProMath · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 95.3%Mistral Large 3: 88.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlHard prompts · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,511Mistral Large 3: 1,433LMArenaAs of 11/11/2026
MMLU ProOthers · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 87.7%Mistral Large 3: 79.2%Vals AIAs of 09/01/2026
LMArena Text, Style ControlHard prompts, English · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,511Mistral Large 3: 1,440LMArenaAs of 11/11/2026
MMLU ProPhilosophy · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 88.4%Mistral Large 3: 76.4%Vals AIAs of 09/01/2026
LMArena Text, Style ControlInstruction following · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 1,490Mistral Large 3: 1,403LMArenaAs of 11/11/2026

More comparisons

Compare GPT-5.6 Sol and Mistral Large 3 with the models people compare them with most often.

Compare another matchup

The most popular comparisons

  1. 1GPT-6 Sol vs. GPT-5.6 Sol
  2. 2GPT-5.6 Sol vs. Gemini 3.8 Flash
  3. 3Claude Opus 5.5 vs. GPT-5.6 Sol
  4. 4GPT-6 Luna vs. GPT-5.6 Sol
  5. 5GPT-6.1 Sol vs. GPT-5.6 Sol
  6. 6GPT-5.6 Sol vs. GLM-5.3-Flash
  7. 7Claude Sonnet 5.5 vs. GPT-5.6 Sol
  8. 8Claude Opus 5.5 vs. Mistral Large 3
  9. 9GPT-5.6 Sol vs. DeepSeek-V4-Pro
Show all 34 comparisons
  1. 10GPT-5.6 Sol vs. DeepSeek-V4.1-Flash
  2. 11GPT-5.6 Sol vs. DeepSeek-V4-Flash
  3. 12GPT-5.6 Sol vs. Grok 4.7
  4. 13Claude Fable 5.1 vs. GPT-5.6 Sol
  5. 14GPT-5.6 Sol vs. Qwen 3.8 27B
  6. 15GPT-5.6 Sol vs. Muse Spark 1.3
  7. 16GPT-5.6 Sol vs. DeepSeek V4.1 Flash 1017
  8. 17GPT-5.6 Sol vs. GPT-5.6 Luna
  9. 18Claude Haiku 5.5 vs. GPT-5.6 Sol
  10. 19Claude Sonnet 5 vs. GPT-5.6 Sol
  11. 20GLM-5.3 vs. Mistral Large 3
  12. 21GPT-5.6 Sol vs. Gemini 3.1 Pro Preview
  13. 22DeepSeek-V4-Flash vs. Mistral Large 3
  14. 23GPT-5.6 Sol vs. Grok 4.6
  15. 24Claude Sonnet 4.6 vs. GPT-5.6 Sol
  16. 25DeepSeek-V4.1-Flash vs. Mistral Large 3
  17. 26GPT-5.6 Sol vs. Kimi K3.1 Pro
  18. 27Claude Haiku 5.5 vs. Mistral Large 3
  19. 28DeepSeek V4.1 Flash 1017 vs. Mistral Large 3
  20. 29Mistral Large 4 vs. Mistral Large 3
  21. 30GPT-5.6 Sol vs. GPT-5.4
  22. 31GPT-5.6 Terra vs. Mistral Large 3
  23. 32GPT-5.6 Sol vs. Gemini 4 Argon
  24. 33GPT-6.1 Terra vs. GPT-5.6 Sol
  25. 34GPT-5.6 Sol vs. Gemini 4 Carbon