Skip to main content

Head-to-head comparison

Claude Sonnet 5.5 vs. Mistral Large 3

Compare published benchmark results from matching versions and cohorts, API pricing, and technical specifications. Any documented test setup differences remain visible.

shared result series
42
distinct benchmarks
4
latest retrieval
2026-10-15

Change model selection

Specifications

General specifications

Release date, availability, context window, architecture, and published parameter counts at a glance. Undisclosed details remain marked as unavailable.

Specifications for Claude Sonnet 5.5 and Mistral Large 3
AttributeClaude Sonnet 5.5Mistral Large 3
ProviderAnthropicMistral AI
ReleasedSep 28, 2026Dec 2, 2025
AvailabilityActiveActive
Model typeProprietaryOpen Weights
ParametersNot published675B, 41B active
ArchitectureNot publishedMixture of Experts
Context window1,000,000 tokens262,144 tokens
Knowledge cutoffJune 2026Not published
Technical sourcesModelModel, Context

Pricing

API pricing compared

The table compares official standard API rates per 1M tokens, including published cache pricing. Batch, fast, priority, regional surcharges, tool calls, and cloud platform pricing are excluded.

API pricing for Claude Sonnet 5.5 and Mistral Large 3
Price typeClaude Sonnet 5.5Mistral Large 3
API input$2$0.5
API output$10$1.5
Cache read$0.1Not listed
Cache write (5 min.)$2.5Not listed
Cache write (1 hr.)$4Not listed
Price verified10/13/2026 Source09/22/2026 Source
Claude Sonnet 5.5Mistral Large 3
API inputUSD per 1M tokens, base tier
Claude Sonnet 5.5$2
Mistral Large 3Lower price$0.5
API outputUSD per 1M tokens, base tier
Claude Sonnet 5.5$10
Mistral Large 3Lower price$1.5

Key to the marks:better valuebetter, but not conclusivetie

Pricing by provider

Direct developer pricing and provider endpoint tariffs routed through OpenRouter are listed separately. Prices are in USD per 1M tokens. Context-dependent direct tiers plus regional, Flex, Priority, and other OpenRouter tariffs remain individually identifiable.

Provider pricing for Claude Sonnet 5.5 and Mistral Large 3
ModelProviderPurchase route and tariffInput per 1M tokensOutput per 1M tokensSource
Claude Sonnet 5.5AnthropicDirect from developerStandard APILowest listed price: $2Lowest listed price: $10Source10/13/2026
Amazon BedrockVia OpenRouteramazon-bedrockLowest listed price: $2Lowest listed price: $10Source10/17/2026
AnthropicVia OpenRouteranthropicLowest listed price: $2Lowest listed price: $10Source10/17/2026
AzureVia OpenRouterazure/globalLowest listed price: $2Lowest listed price: $10Source10/17/2026
AzureVia OpenRouterazure/us$2.2$11Source10/17/2026
Claude Platform on AWSVia OpenRouterclaude-on-awsLowest listed price: $2Lowest listed price: $10Source10/17/2026
GoogleVia OpenRoutergoogle-vertex/europe$2.2$11Source10/17/2026
GoogleVia OpenRoutergoogle-vertex/globalLowest listed price: $2Lowest listed price: $10Source10/17/2026
GoogleVia OpenRoutergoogle-vertex/us$2.2$11Source10/17/2026
Mistral Large 3Mistral AIDirect from developerStandard APILowest listed price: $0.5Lowest listed price: $1.5Source09/22/2026
MistralVia OpenRoutermistral/eu$0.55$1.65Source10/17/2026
MistralVia OpenRoutermistral/zdrLowest listed price: $0.5Lowest listed price: $1.5Source10/17/2026

Performance

Shared benchmarks

Only published results with the same benchmark version, task, metric, and comparison cohort are paired. Different reasoning levels, agents, harnesses, or output limits appear directly in the table.

Capability profile from matched benchmarks

Each axis averages directly matched benchmark families. A value of 100 means the stronger value within this pair, not a universal quality score.

Not enough directly matched categories for a reliable radar

Only 0 of at least 5 categories have comparable, direct model measurements. The benchmark tables below show the available evidence without filling missing axes.

Claude Sonnet 5.5Mistral Large 3
LMArena Code Arena WebDevOverall. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,712.984
Mistral Large 31,230.205
LMArena Text, Style ControlOverall. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,475.266
Mistral Large 31,414.136
LMArena Vision, Style ControlOverall. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,266.189
Mistral Large 31,199.757
SAGEOverall. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value51.772 %
Mistral Large 324.595 %
LMArena Code Arena WebDevOverall. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,773.661
Mistral Large 31,230.205
LMArena Text, Style ControlBusiness, management and finance. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,466.655
Mistral Large 31,409.853
LMArena Vision, Style ControlDiagram. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,320.26
Mistral Large 31,235.106
SAGEAutomata. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value43.254 %
Mistral Large 311.905 %
LMArena Code Arena WebDevImage to webdev. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,740.047
Mistral Large 31,361.78
LMArena Text, Style ControlChinese. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,546.494
Mistral Large 31,432.609
LMArena Vision, Style ControlEnglish. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value1,266.361
Mistral Large 31,210.278
SAGECalculus. Higher is better. Test setup not documented as identical
Claude Sonnet 5.5Higher measured value78.395 %
Mistral Large 30 %

Key to the marks:better valuebetter, but not conclusivetie

Benchmark scores for Claude Sonnet 5.5 and Mistral Large 3
Benchmark and taskClaude Sonnet 5.5Mistral Large 3Source
LMArena Code Arena WebDevOverall
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-high, Reasoning: high, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 4,605 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes.
Higher measured value1,712.984
95% confidence interval: ±10.362The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,230.205
95% confidence interval: ±25.485The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlOverall
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 6,254 published pairwise votes.Mistral Large 3: Arena rating from 83,498 published pairwise votes.
Higher measured value1,475.266
95% confidence interval: ±7.984The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,414.136
95% confidence interval: ±2.865The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Vision, Style ControlOverall
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Vision, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Vision, style control
Claude Sonnet 5.5: Arena rating from 2,068 published pairwise votes.Mistral Large 3: Arena rating from 8,643 published pairwise votes.
Higher measured value1,266.189
95% confidence interval: ±13.713The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,199.757
95% confidence interval: ±7.981The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/09/2026
SAGEOverall
Test details
Test setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterClaude Sonnet 5.5: Compute: max, Temperature: 1, Output limit: 128,000 tokens
Mistral Large 3: Temperature: 1, Output limit: 30,000 tokens
Higher measured value51.772 %
24.595 %
Vals AI
Source details
Data as of: 10/08/2026
LMArena Code Arena WebDevOverall
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 2,858 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes.
Higher measured value1,773.661
95% confidence interval: ±13.85The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,230.205
95% confidence interval: ±25.485The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlBusiness, management and finance
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,089 published pairwise votes.Mistral Large 3: Arena rating from 15,540 published pairwise votes.
Higher measured value1,466.655
95% confidence interval: ±17.914The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,409.853
95% confidence interval: ±5.362The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Vision, Style ControlDiagram
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Vision, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Vision, style control
Claude Sonnet 5.5: Arena rating from 514 published pairwise votes.Mistral Large 3: Arena rating from 2,169 published pairwise votes.
Higher measured value1,320.26
95% confidence interval: ±26.586The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,235.106
95% confidence interval: ±13.517The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/09/2026
SAGEAutomata
Test details
Test setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterClaude Sonnet 5.5: Compute: max, Temperature: 1, Output limit: 128,000 tokens
Mistral Large 3: Temperature: 1, Output limit: 30,000 tokens
Higher measured value43.254 %
11.905 %
Vals AI
Source details
Data as of: 10/08/2026
LMArena Code Arena WebDevImage to webdev
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 1,074 published pairwise votes.Mistral Large 3: Arena rating from 1,413 published pairwise votes.
Higher measured value1,740.047
95% confidence interval: ±19.9The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,361.78
95% confidence interval: ±17.387The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/09/2026
LMArena Text, Style ControlChinese
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 508 published pairwise votes.Mistral Large 3: Arena rating from 6,341 published pairwise votes.
Higher measured value1,546.494
95% confidence interval: ±26.454The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,432.609
95% confidence interval: ±7.919The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Vision, Style ControlEnglish
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Vision, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Vision, style control
Claude Sonnet 5.5: Arena rating from 657 published pairwise votes.Mistral Large 3: Arena rating from 2,983 published pairwise votes.
Higher measured value1,266.361
95% confidence interval: ±23.51The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,210.278
95% confidence interval: ±12.173The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/09/2026
SAGECalculus
Test details
Test setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterClaude Sonnet 5.5: Compute: max, Temperature: 1, Output limit: 128,000 tokens
Mistral Large 3: Temperature: 1, Output limit: 30,000 tokens
Higher measured value78.395 %
0 %
Vals AI
Source details
Data as of: 10/08/2026
LMArena Code Arena WebDevWebdev
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-high, Reasoning: high, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 4,605 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes.
Higher measured value1,712.984
95% confidence interval: ±10.362The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,230.205
95% confidence interval: ±25.485The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlCoding
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,506 published pairwise votes.Mistral Large 3: Arena rating from 21,009 published pairwise votes.
Higher measured value1,526.562
95% confidence interval: ±15.395The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,470.833
95% confidence interval: ±4.783The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Vision, Style ControlHomework
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Vision, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Vision, style control
Claude Sonnet 5.5: Arena rating from 295 published pairwise votes.Mistral Large 3: Arena rating from 891 published pairwise votes.
Higher measured value1,318.835
95% confidence interval: ±34.105The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,211.931
95% confidence interval: ±20.61The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/09/2026
SAGELinear Algebra
Test details
Test setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterClaude Sonnet 5.5: Compute: max, Temperature: 1, Output limit: 128,000 tokens
Mistral Large 3: Temperature: 1, Output limit: 30,000 tokens
Higher measured value70.792 %
44.419 %
Vals AI
Source details
Data as of: 10/08/2026
LMArena Code Arena WebDevWebdev
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 2,858 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes.
Higher measured value1,773.661
95% confidence interval: ±13.85The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,230.205
95% confidence interval: ±25.485The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlCreative writing
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,405 published pairwise votes.Mistral Large 3: Arena rating from 14,972 published pairwise votes.
Higher measured value1,465.364
95% confidence interval: ±16.888The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,373.958
95% confidence interval: ±5.611The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Vision, Style ControlOcr
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Vision, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Vision, style control
Claude Sonnet 5.5: Arena rating from 1,451 published pairwise votes.Mistral Large 3: Arena rating from 5,778 published pairwise votes.
Higher measured value1,280.319
95% confidence interval: ±15.866The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,215.499
95% confidence interval: ±8.709The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/09/2026
SAGEPartial Differential Equations
Test details
Test setup not documented as identicalNo direct winnerVersion: 1Metric: accuracyScoring: Higher is betterClaude Sonnet 5.5: Compute: max, Temperature: 1, Output limit: 128,000 tokens
Mistral Large 3: Temperature: 1, Output limit: 30,000 tokens
Higher measured value41.27 %
17.46 %
Vals AI
Source details
Data as of: 10/08/2026
LMArena Code Arena WebDevWebdev-html
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-high, Reasoning: high, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 707 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes.
Higher measured value1,710.04
95% confidence interval: ±25.597The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,238.427
95% confidence interval: ±26.132The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlEnglish
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 2,393 published pairwise votes.Mistral Large 3: Arena rating from 34,656 published pairwise votes.
Higher measured value1,490.413
95% confidence interval: ±12.395The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,426.99
95% confidence interval: ±3.961The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Code Arena WebDevWebdev-html
Test details
Test setup not documented as identicalNo direct winnerVersion: webdevMetric: WebDev Arena Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Code Arena WebDev
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Code Arena WebDev
Claude Sonnet 5.5: Arena rating from 423 published pairwise votes.Mistral Large 3: Arena rating from 839 published pairwise votes.
Higher measured value1,737.658
95% confidence interval: ±36.636The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,238.427
95% confidence interval: ±26.132The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlEntertainment, sports and media
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,576 published pairwise votes.Mistral Large 3: Arena rating from 18,448 published pairwise votes.
Higher measured value1,460.568
95% confidence interval: ±15.574The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,372.089
95% confidence interval: ±5.132The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlExcluding ties
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 4,571 published pairwise votes.Mistral Large 3: Arena rating from 61,071 published pairwise votes.
Higher measured value1,484.539
95% confidence interval: ±10.917The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,401.523
95% confidence interval: ±3.976The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlExpert prompts
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 646 published pairwise votes.Mistral Large 3: Arena rating from 7,976 published pairwise votes.
Higher measured value1,540.048
95% confidence interval: ±22.903The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,427.286
95% confidence interval: ±7.215The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlFrench
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 234 published pairwise votes.Mistral Large 3: Arena rating from 2,379 published pairwise votes.
Higher measured value1,506.412
95% confidence interval: ±37.292The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,432.543
95% confidence interval: ±13.786The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlHard prompts
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 3,886 published pairwise votes.Mistral Large 3: Arena rating from 50,980 published pairwise votes.
Higher measured value1,504.575
95% confidence interval: ±9.87The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,432.155
95% confidence interval: ±3.56The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlHard prompts, English
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,488 published pairwise votes.Mistral Large 3: Arena rating from 21,186 published pairwise votes.
Higher measured value1,513.396
95% confidence interval: ±15.55The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,439.589
95% confidence interval: ±4.785The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlInstruction following
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 2,124 published pairwise votes.Mistral Large 3: Arena rating from 26,939 published pairwise votes.
Higher measured value1,483.211
95% confidence interval: ±13.051The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,401.72
95% confidence interval: ±4.374The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlLegal and government
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 541 published pairwise votes.Mistral Large 3: Arena rating from 6,347 published pairwise votes.
Higher measured value1,495.003
95% confidence interval: ±25.225The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,420.684
95% confidence interval: ±7.935The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlLife, physical and social science
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,089 published pairwise votes.Mistral Large 3: Arena rating from 13,640 published pairwise votes.
Higher measured value1,491.487
95% confidence interval: ±18.249The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,428.444
95% confidence interval: ±5.571The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlLonger queries
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 2,627 published pairwise votes.Mistral Large 3: Arena rating from 31,737 published pairwise votes.
Higher measured value1,500.318
95% confidence interval: ±12.253The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,417.413
95% confidence interval: ±4.313The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlMath
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 318 published pairwise votes.Mistral Large 3: Arena rating from 4,742 published pairwise votes.
Higher measured value1,509.977
95% confidence interval: ±32.41The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,400.815
95% confidence interval: ±8.893The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlMathematical professions
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 324 published pairwise votes.Mistral Large 3: Arena rating from 4,407 published pairwise votes.
Higher measured value1,519.842
95% confidence interval: ±31.806The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,413.768
95% confidence interval: ±9.421The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlMedicine and healthcare
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 432 published pairwise votes.Mistral Large 3: Arena rating from 5,848 published pairwise votes.
Higher measured value1,470.002
95% confidence interval: ±28.167The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,431.33
95% confidence interval: ±8.313The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlMulti-turn
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 919 published pairwise votes.Mistral Large 3: Arena rating from 14,021 published pairwise votes.
Higher measured value1,471.318
95% confidence interval: ±19.351The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,420.254
95% confidence interval: ±5.589The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlNon-English
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 3,861 published pairwise votes.Mistral Large 3: Arena rating from 48,836 published pairwise votes.
Higher measured value1,458.177
95% confidence interval: ±9.868The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,398.12
95% confidence interval: ±3.514The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlRussian
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 880 published pairwise votes.Mistral Large 3: Arena rating from 10,065 published pairwise votes.
Higher measured value1,456.017
95% confidence interval: ±19.884The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,408.261
95% confidence interval: ±6.27The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlSoftware and IT services
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 2,184 published pairwise votes.Mistral Large 3: Arena rating from 31,163 published pairwise votes.
Higher measured value1,514.674
95% confidence interval: ±12.864The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,456.413
95% confidence interval: ±4.147The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlSpanish
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 210 published pairwise votes.Mistral Large 3: Arena rating from 2,503 published pairwise votes.
Higher measured value1,453.486
95% confidence interval: ±39.439The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,406.692
95% confidence interval: ±12.904The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026
LMArena Text, Style ControlWriting, literature and language
Test details
Test setup not documented as identicalNo direct winnerVersion: style-control-v1Metric: style-controlled Bradley-Terry ratingScoring: Higher is betterClaude Sonnet 5.5: Snapshot: claude-sonnet-5.5-xhigh, Reasoning: xhigh, Harness: Arena Text, style control
Mistral Large 3: Snapshot: mistral-large-3, Harness: Arena Text, style control
Claude Sonnet 5.5: Arena rating from 1,744 published pairwise votes.Mistral Large 3: Arena rating from 20,857 published pairwise votes.
Higher measured value1,470.538
95% confidence interval: ±14.875The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
1,389.216
95% confidence interval: ±4.844The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
LMArena
Source details
Data as of: 10/13/2026

Key to the marks:better valuebetter, but not conclusivetie

Our model tests

Our tests

SVG short test

One SVG prompt and fixed output settings. Captures are shown only with 0 reported reasoning tokens or documented lack of reasoning controls. Identical test conditions do not make the models' internal compute identical.

Shared test round: 4ae5d8eeb9a9

Claude Sonnet 5.5

Unavailable in this round

Mistral Large 3

API request failed. The model was not evaluated.

Earlier tests

Pelican on a bicycle

A community classic for free-form SVG drawing.

Claude Sonnet 5.5

Claude Sonnet 5.5: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (requested): high

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
anthropic/claude-sonnet-5.5
API model reported in response
anthropic/claude-sonnet-5.5
Reasoning setting
high
Pinned endpoint
Anthropic | anthropic/claude-sonnet-5.5-20260928
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
28.2 s

Visually reviewed. This individual test does not establish overall model quality.

Mistral Large 3

Mistral Large 3: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (model default): no reasoning mode Source

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
mistralai/mistral-large-2512
API model reported in response
mistralai/mistral-large-2512
Reasoning setting
not specified
Pinned endpoint
Mistral | mistralai/mistral-large-2512
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
14.2 s

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)
  • Sep 7, 2026API request failedReasoning setting: not specified
Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

How to read this comparison

Winning one benchmark is not an overall verdict

Your workload, budget, and required context length matter most. A coding benchmark says little about visual understanding or agent performance.

The standard price table uses direct developer rates. The provider comparison labels OpenRouter endpoints, regions, and special tariffs separately.

Every result links to its measurement source and retrieval date. Labels distinguish vendor reports, official benchmark leaderboards, and independent evaluations. Disputed or archived results are excluded.

More matchups

Compare Claude Sonnet 5.5 and Mistral Large 3 with other leading models using the same data and benchmark logic.

View the complete LLM comparison