Mistral Nemo
Not tested yet
Language modelActive
Mistral Nemo
Mistral AI
- Released
- July 18, 2024
- Data date
- September 8, 2026
- Intelligence
- Overall score
- Price
- Input · Output / 1M tokens
- Input
- Text
- Output
- Text
No published category-wide ranking is available for this model.
Entries 1-12 of 16. Page 1 of 2.
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
HellaSwag (Show measurement, test conditions, and source)
- Source value
- 83.5
- Score
- 83.5
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:0
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
Winogrande (Show measurement, test conditions, and source)
- Source value
- 76.8
- Score
- 76.8
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:1
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
OpenBookQA (Show measurement, test conditions, and source)
- Source value
- 60.6
- Score
- 60.6
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:2
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
CommonSenseQA (Show measurement, test conditions, and source)
- Source value
- 70.4
- Score
- 70.4
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:3
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
TruthfulQA (Show measurement, test conditions, and source)
- Source value
- 50.3
- Score
- 50.3
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:4
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
MMLU (Show measurement, test conditions, and source)
- Source value
- 68
- Score
- 68
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:5
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
TriviaQA (Show measurement, test conditions, and source)
- Source value
- 73.8
- Score
- 73.8
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:6
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
NQ (Show measurement, test conditions, and source)
- Source value
- 31.2
- Score
- 31.2
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:7
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Card benchmark table; exact shots not stated
French MMLU (Show measurement, test conditions, and source)
- Source value
- 62.3
- Score
- 62.3
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:8
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Multilingual MMLU table
German MMLU (Show measurement, test conditions, and source)
- Source value
- 62.7
- Score
- 62.7
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:9
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Multilingual MMLU table
Spanish MMLU (Show measurement, test conditions, and source)
- Source value
- 64.6
- Score
- 64.6
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:10
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Multilingual MMLU table
Italian MMLU (Show measurement, test conditions, and source)
- Source value
- 61.3
- Score
- 61.3
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Comparison cohort
- research:mistral-nemo:11
- Source type
- vendor-reported
- Evaluator
- Mistral Nemo model card
- Status
- active
- Retrieved at
- 2026-09-08
- Methodology
- Vendor-reported result. Instruct table; Multilingual MMLU table
Our model tests
Community tests you can inspect
Compare how the models respond to the same prompt. Each test shows the first attempt, with no subsequent fixes to the generated code. These results do not contribute to an overall score.
Pelican on a bicycle
A community classic for free-form SVG drawing.
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)Profile
Specifications and access
Published information about this model. Existing estimates are explicitly labeled.
Additional source observations
Dated documentation and model-card observations. Provider limits, native context and extended context can differ. Configuration notes retain the source wording.
Pricing
Published prices
Prices apply to the stated unit. Resolution, output length, and provider can change the cost.
Cost example
100 API requests
$0.0034
100 requests with 1,000 input and 500 output tokens each calculate to $0.0034. Input accounts for $0.0019; output accounts for $0.0015.
- Input price
- $0.019 / 1M tokensBase tier for each request
- Output price
- $0.03 / 1M tokensBase tier for each request
The calculation uses documented token prices and no cache discount. It excludes extra tools, tax, reasoning tokens, and further hidden output tokens.
Open sourceHead-to-head comparisons
Compare this model
Each matchup compares this model with exactly one other model from the same category.
There are no published direct comparisons for this model yet.
More models
Models from the same selection
All AI models
Evidence
Sources and data date
Every statement links to its underlying documentation or leaderboard.
- Price
Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs.
- Input
Documented modalities. Retrieved September 8, 2026.
- Output
Documented modalities. Retrieved September 8, 2026.
Research date September 8, 2026. 3 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Open evidence questions and research notes (original wording)
Not found in the inspected sources
knowledge-cutoff. Inventory has an April 2024 value, but the checked official card/release does not publish it; do not treat inventory as evidence.
Not found in the inspected sources
training-tokens. No token count found.
Not found in the inspected sources
max-output-tokens. No model-specific maximum output found.
Unresolved
AA benchmark rows. No exact Artificial Analysis model page located in the checked public sitemap.