Mistral Nemo: Specifications & Sources

Specifications and access

Specification	Value and source
Weights	Open weightsSource
Access	LocalSource
Parameters	12BSource
Context window	131,072 tokensSource
License	Apache-2.0Source
Release	2024-07-18Source
Parameters	12 BSource
Architecture	40-layer transformer, dim 5120, GQA with 8 KV heads, 128k vocabularySource
Input	TextSource
Output	TextSource
API model ID	open-mistral-nemo-2407Source
Tool calling	YesSource

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

HellaSwag (Show measurement, test conditions, and source)

Source value: 83.5
Score: 83.5
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

Winogrande (Show measurement, test conditions, and source)

Source value: 76.8
Score: 76.8
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

OpenBookQA (Show measurement, test conditions, and source)

Source value: 60.6
Score: 60.6
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

CommonSenseQA (Show measurement, test conditions, and source)

Source value: 70.4
Score: 70.4
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

TruthfulQA (Show measurement, test conditions, and source)

Source value: 50.3
Score: 50.3
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

MMLU (Show measurement, test conditions, and source)

Source value: 68
Score: 68
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

TriviaQA (Show measurement, test conditions, and source)

Source value: 73.8
Score: 73.8
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

NQ (Show measurement, test conditions, and source)

Source value: 31.2
Score: 31.2
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated

Source Mistral Nemo model card

French MMLU (Show measurement, test conditions, and source)

Source value: 62.3
Score: 62.3
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Multilingual MMLU table

Source Mistral Nemo model card

German MMLU (Show measurement, test conditions, and source)

Source value: 62.7
Score: 62.7
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Multilingual MMLU table

Source Mistral Nemo model card

Spanish MMLU (Show measurement, test conditions, and source)

Source value: 64.6
Score: 64.6
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Multilingual MMLU table

Source Mistral Nemo model card

Italian MMLU (Show measurement, test conditions, and source)

Source value: 61.3
Score: 61.3
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Mistral Nemo model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; Multilingual MMLU table

Source Mistral Nemo model card

Page 1 of 2

Our tests

Each test shows the latest attempt, with no subsequent fixes to the generated code. Earlier runs remain available in the test details. These results do not contribute to an overall score.

Pelican on a bicycle

A community classic for free-form SVG drawing.

Mistral Nemo

Reasoning (requested): not specified

Current attempt

Run date: 1 Oct 2026
API provider: openrouter
Requested API model: mistralai/mistral-nemo
API model reported in response: mistralai/mistral-nemo
Reasoning setting: not specified
Pinned endpoint: Mistral | mistralai/mistral-nemo
Temperature: Provider default
Token limit including reasoning: 8,192 tokens
Test protocol: community-visual-tests-v1
Technical checks: Passed, not a quality rating
Response time: 10.8 s

Visually reviewed. This individual test does not establish overall model quality.

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

Popularity

41.2 / 100

Published prices

No current API rate confirmed. These historical rates were last verified on August 22, 2026.

API input (historical): $0.019 per 1M tokensSource
API output (historical): $0.03 per 1M tokensSource

Sources and data date

Type	Evidence and data date
Input	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Mistral Nemo model card · Editorial description reviewed October 2, 2026
Output	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Mistral Nemo model card · Editorial description reviewed October 2, 2026
Research status	Research date September 8, 2026. 3 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not found in the inspected sources	knowledge-cutoff Original wording Inventory has an April 2024 value, but the checked official card/release does not publish it; do not treat inventory as evidence.
Not found in the inspected sources	training-tokens Original wording No token count found.
Not found in the inspected sources	max-output-tokens Original wording No model-specific maximum output found.
Unresolved	AA benchmark rows Original wording No exact Artificial Analysis model page located in the checked public sitemap.
Additional source	Context window data
Additional source	API pricing
Additional source	Model metadata (retrieved September 8, 2026) · Mistral Nemo announcement · Editorial description reviewed October 2, 2026
Additional source	Mistral model overview · Editorial description reviewed October 2, 2026
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Creative Commons Attribution 4.0