Mistral Small 3: Specifications & Sources

Specifications and access

Specification	Value and source
Weights	Open weightsSource
Access	LocalSource
Parameters	24BSource
Context window	32,768 tokensSource
Knowledge cutoff	October 1, 2023Source
Notes	Dense 24B model in the small Mistral model familySource
License	Apache-2.0Source
Release	2025-01-30Source
Parameters	24 BSource
Context window	32,768 tokens (Inventory contained 128k; the primary model card explicitly says 32k, so the card is used.)Source
Knowledge cutoff	2023-10-01Source
Input	TextSource
Output	TextSource
Tool calling	YesSource
Structured output	YesSource

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

WildBench (Show measurement, test conditions, and source)

Source value: 52.27
Score: 52.27
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Public model-card table; judge/config not stated

Source Mistral Small 3 model card

MMLU Pro (Show measurement, test conditions, and source)

Source value: 0.663
Score: 0.663
Metric: ratio
Unit: ratio
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; RawFraction [0,1]; Public model-card table; exact shot count not stated

Source Mistral Small 3 model card

GPQA Main (Show measurement, test conditions, and source)

Source value: 0.453
Score: 0.453
Metric: ratio
Unit: ratio
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; RawFraction [0,1]; Public model-card table; exact shot count not stated

Source Mistral Small 3 model card

HumanEval (Show measurement, test conditions, and source)

Source value: 0.848
Score: 0.848
Metric: ratio
Unit: ratio
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; RawFraction [0,1]; Public model-card table; exact pass@1 setup not stated

Source Mistral Small 3 model card

MATH (Show measurement, test conditions, and source)

Source value: 0.706
Score: 0.706
Metric: ratio
Unit: ratio
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; RawFraction [0,1]; Public model-card table; exact setup not stated

Source Mistral Small 3 model card

MTBench (Show measurement, test conditions, and source)

Source value: 8.35
Score: 8.35
Metric: rating
Unit: rating
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Public model-card table; judge/config not stated

Source Mistral Small 3 model card

Arena Hard (Show measurement, test conditions, and source)

Source value: 0.873
Score: 0.873
Metric: ratio
Unit: ratio
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; RawFraction [0,1]; Public model-card table; exact normalization not stated

Source Mistral Small 3 model card

IFEval (Show measurement, test conditions, and source)

Source value: 0.829
Score: 0.829
Metric: ratio
Unit: ratio
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Small 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; RawFraction [0,1]; Public model-card table; exact setup not stated

Source Mistral Small 3 model card

Artificial Analysis Intelligence Index (Show measurement, test conditions, and source)

Source value: 6.67120856746569
Score: 6.67120856746569
Metric: points
Unit: points
Direction: Higher is better
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-09-08
Methodology: Independent evaluation. unknown

Source Artificial Analysis

Output speed (Show measurement, test conditions, and source)

Source value: 155.125272483902
Score: 155.125272483902
Metric: tokens/s
Unit: tokens/s
Direction: Higher is better
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-09-08
Methodology: Independent evaluation. unknown; default 10K-input workload only
Context: Artificial Analysis performance timing; output speed is decoded after the first streaming chunk. Provider basis: first-party API. Deprecated model. Artificial Analysis only continues benchmarking the default 10K-input workload.

Source Artificial Analysis

Latency reasoning time (Show measurement, test conditions, and source)

Source value: 0
Score: 0
Metric: seconds
Unit: seconds
Direction: Lower is better
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-09-08
Methodology: Independent evaluation. unknown; default 10K-input workload only
Context: Artificial Analysis performance timing; output speed is decoded after the first streaming chunk. Provider basis: first-party API. Deprecated model. Artificial Analysis only continues benchmarking the default 10K-input workload.

Source Artificial Analysis

Latency input time (Show measurement, test conditions, and source)

Source value: 0.751329539500006
Score: 0.751329539500006
Metric: seconds
Unit: seconds
Direction: Lower is better
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-09-08
Methodology: Independent evaluation. unknown; default 10K-input workload only
Context: Artificial Analysis performance timing; output speed is decoded after the first streaming chunk. Provider basis: first-party API. Deprecated model. Artificial Analysis only continues benchmarking the default 10K-input workload.

Source Artificial Analysis

Page 1 of 2

Our tests

Each test shows the latest attempt, with no subsequent fixes to the generated code. Earlier runs remain available in the test details. These results do not contribute to an overall score.

Pelican on a bicycle

A community classic for free-form SVG drawing.

Mistral Small 3

Reasoning (requested): not specified

Current attempt

Run date: 1 Oct 2026
API provider: openrouter
Requested API model: mistralai/mistral-small-24b-instruct-2501
API model reported in response: mistralai/mistral-small-24b-instruct-2501
Reasoning setting: not specified
Pinned endpoint: DeepInfra | mistralai/mistral-small-24b-instruct-2501
Temperature: Provider default
Token limit including reasoning: 8,192 tokens
Test protocol: community-visual-tests-v1
Technical checks: Passed, not a quality rating
Response time: 11.9 s

Visually reviewed. This individual test does not establish overall model quality.

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

Popularity

33.8 / 100

Published prices

No current API rate confirmed. These historical rates were last verified on August 22, 2026.

API input (historical): $0.05 per 1M tokensSource
API output (historical): $0.08 per 1M tokensSource

Predecessor and successor

Sources and data date

Type	Evidence and data date
Speed	Mistral. Output speed after the first streaming chunk, not total response time. Classified as deprecated by Artificial Analysis. Artificial Analysis maintains only the default 10K-input workload there. Retrieved September 8, 2026. Source: Artificial Analysis · Artificial Analysis (retrieved September 8, 2026)Speed measurement methodology
Input	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Mistral Small 3 model card · Editorial description reviewed October 2, 2026
Output	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Mistral Small 3 model card · Editorial description reviewed October 2, 2026
Research status	Research date September 8, 2026. 3 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Unresolved	context-discrepancy Original wording Inventory says 128k while the official card says 32k; retain the card value and flag for alias/data review.
Not found in the inspected sources	training-tokens Original wording No token count found.
Not found in the inspected sources	max-output-tokens Original wording No model-specific maximum output found.
Additional source	Context window data
Additional source	Knowledge cutoff data
Additional source	API pricing
Additional source	Model metadata (retrieved September 8, 2026) · Mistral Small 3 announcement · Editorial description reviewed October 2, 2026
Additional source	Mistral model overview · Editorial description reviewed October 2, 2026
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Creative Commons Attribution 4.0
Additional source	Mistral AI, "Mistral Small 3.1" (2026-09-19)