Language modelActive

Ministral 3 3B

Mistral AI

Released: December 2, 2025
Data date: September 8, 2026
Predecessor: Ministral 3B (Official documentation)

Benchmark-Meta-Score: Unavailable
Results from one source only
Speed: 185.8 tokens/s
Output throughput
Price: $0.1 · $0.1
Input · Output / 1M tokens
Input: Text, Image
Output: Text

What is distinctive about Ministral 3 3B is that Mistral’s smallest open multimodal variant still brings 256,000 tokens of context and image and text input. Its text component has about 3.4 billion parameters plus a vision encoder.

Ministral 3 8B is the larger sibling in the multimodal Mistral 3 family.

Specifications and access

Specification	Value and source
Weights	Open weightsSource
Access	API, LocalSource
Parameters	3.8BSource
Context window	262,144 tokensSource
License	Apache-2.0Source
Release	2025-12-02Source
Parameters	3.8 BSource
Architecture	3.4B language model plus 0.4B vision encoderSource
Input	Text, ImageSource
Output	TextSource
Tool calling	YesSource
Structured output	YesSource

Benchmark meta-analysis

Overall and area scores

These Gradually indexes place selected published measurements on a 0 to 100 scale. They are not accuracy percentages and do not guarantee results in your application.

Retrieval dates of the sources used 2026-10-19 - 2026-10-19

Overall index

Not enough independent results for a score yet

An overall score needs results from at least two sources.

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Test series: 10
Test families: 10 / 65
Sources: 1
Share of the fixed test panel (informative): 14 %

Coding

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 1
Test families: 1 / 15
Sources: 1
Share of the fixed test panel (informative): 3 %

Reasoning

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 3
Test families: 3 / 7
Sources: 1
Share of the fixed test panel (informative): 36 %

Knowledge

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 1
Test families: 1 / 3
Sources: 1
Share of the fixed test panel (informative): 33 %

Agents

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 3
Test families: 3 / 12
Sources: 1
Share of the fixed test panel (informative): 25 %

General

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 1
Test families: 1 / 5
Sources: 1
Share of the fixed test panel (informative): 20 %

Multimodal

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 1
Test families: 1 / 4
Sources: 1
Share of the fixed test panel (informative): 13 %

Documented method · Included test families and measurements

Method version: benchmark-meta-score-v3

The index includes active measurements from reviewed primary sources when at least five models are compared in the same documented comparison slice across dataset, harness, agent, tools, and trial count. Each benchmark series and evaluator contributes one shared setup slice from the newest capture. When one source and series include several explicitly documented reasoning tiers, the highest documented tier (none through max) is selected, never the best result value. The explicit source label “Non-reasoning” is treated as none. Unknown or ambiguous tiers exclude the model from that series. Within each series, percentages and rates are logit-transformed, other units stay unchanged, and all values are then standardized. A one-factor model then estimates one shared strength per model and, per series, how sharply it separates the models. Area scores move away from that strength only as far as the model's own results in the area support. The overall score weights the core areas at 75% and finance, law and health at 25%. It requires at least eight test series from two sources and three areas. The 0 to 100 scale refers to a fixed reference group of 29 language models whose average sits at 50.

Published model-specific parameters can differ. This is not a controlled experiment; comparisons with such differences are marked provisional.

Unmeasured series are not entered as zero. Where a model has no own results in a core area, its overall strength stands in, and the note “estimated without own results in …” names the area. Fewer test series lead to a larger standard error.

The 95% interval follows from the standard error of 200 recalculations with randomly redrawn test families. It describes how precisely the recorded test series determine the value. It is no prediction for future tasks or for later recalculations with other participants.

The source count is not a count of independent experiments.

OECD handbook on composite indicators

All 10 test families and 10 of 10 raw measurements are listed here. The complete calculation for every model is available in the JSON export.

Test family: AA-Briefcase
Agents · Mean rank percentile of the family: 3.0 / 100
Family weight in the fixed test panel (informative): 0.89 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-briefcase
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.89 %
  Raw value:
  0 Elo
  Metric:
  AA-Briefcase Elo
  Version:
  v1.1
  Participating models:
  83
  Rank percentile within the cohort:
  3.0 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-briefcase:v1.1:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-briefcase","v1.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-LCR
Reasoning · Mean rank percentile of the family: 0.0 / 100
Family weight in the fixed test panel (informative): 1.53 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-lcr
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.53 %
  Raw value:
  17 %
  Metric:
  Pass rate
  Version:
  v1.1
  Participating models:
  83
  Rank percentile within the cohort:
  0.0 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-lcr:v1.1:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-lcr","v1.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 17.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AutomationBench-AA
Agents · Mean rank percentile of the family: 13.4 / 100
Family weight in the fixed test panel (informative): 0.89 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-automationbench-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.89 %
  Raw value:
  0.6658657772309807 %
  Metric:
  Objectives completed without guardrail violations
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  13.4 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-automationbench-aa:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-automationbench-aa","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.7%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GDP.pdf
Reasoning · Mean rank percentile of the family: 1.8 / 100
Family weight in the fixed test panel (informative): 1.53 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-gdp-pdf
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.53 %
  Raw value:
  0 %
  Metric:
  All-pass rate
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  1.8 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-gdp-pdf:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-gdp-pdf","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GDPval-AA
Agents · Mean rank percentile of the family: 4.9 / 100
Family weight in the fixed test panel (informative): 0.89 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-gdpval-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.89 %
  Raw value:
  29.62 Elo
  Metric:
  GDPval-AA Elo
  Version:
  v2.1
  Participating models:
  83
  Rank percentile within the cohort:
  4.9 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-gdpval-aa:v2.1:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-gdpval-aa","v2.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: IFBench
General · Mean rank percentile of the family: 2.9 / 100
Family weight in the fixed test panel (informative): 2.14 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-ifbench
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  2.14 %
  Raw value:
  26.802721088435398 %
  Metric:
  IFBench prompt-level loose accuracy (pass@1)
  Version:
  AA test set: 294 questions
  Participating models:
  70
  Rank percentile within the cohort:
  2.9 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-ifbench:AA test set: 294 questions:standalone:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-ifbench","AA test set: 294 questions","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Tool policy:
  Single-turn answer evaluated with the official IFBench source code
  Attempts:
  pass@1, 5 repeats per question
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Score display: 26.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-Omniscience
Knowledge · Mean rank percentile of the family: 2.4 / 100
Family weight in the fixed test panel (informative): 3.57 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-omniscience
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  3.57 %
  Raw value:
  -64 points
  Metric:
  AA-Omniscience Index
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  2.4 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-omniscience:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-omniscience","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: Humanity’s Last Exam
Reasoning · Mean rank percentile of the family: 11.0 / 100
Family weight in the fixed test panel (informative): 1.53 % · Coverage of this test family: 50 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-humanitys-last-exam
  Series weight within the test family:
  50 %
  Nominal contribution to the overall panel:
  0.77 %
  Raw value:
  5.37534754402224 %
  Metric:
  Text-only pass@1 accuracy
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  11.0 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-humanitys-last-exam:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-humanitys-last-exam","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 5.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: MMMU-Pro
Multimodal · Mean rank percentile of the family: 0.0 / 100
Family weight in the fixed test panel (informative): 2.68 % · Coverage of this test family: 50 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-mmmu-pro
  Series weight within the test family:
  50 %
  Nominal contribution to the overall panel:
  1.34 %
  Raw value:
  38.092485549132896 %
  Metric:
  pass@1 accuracy
  Version:
  AA cohort: 1,730 questions
  Participating models:
  57
  Rank percentile within the cohort:
  0.0 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-mmmu-pro","AA cohort: 1,730 questions","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Tool policy:
  Ten-option multiple choice; regex answer extraction
  Attempts:
  pass@1, one run per question
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning. Score display: 38.1%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: Terminal-Bench
Coding · Mean rank percentile of the family: 17.7 / 100
Family weight in the fixed test panel (informative): 0.71 % · Coverage of this test family: 50 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-terminal-bench-4
  Series weight within the test family:
  50 %
  Nominal contribution to the overall panel:
  0.36 %
  Raw value:
  0 %
  Metric:
  Task success
  Version:
  4.0
  Participating models:
  83
  Rank percentile within the cohort:
  17.7 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-terminal-bench-4:4.0:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-terminal-bench-4","4.0","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
  Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19

Benchmark sources at a glance

Each evaluator measures different capabilities under its own conditions. Test series, composite indices and their components stay separate. The detailed results below retain their scales, configurations and source dates.

Evaluator	Test series	Composite indices	Recorded active measurements
Artificial Analysis	10	1	23

Coverage is not a quality ranking. Overlapping tests and multiple settings do not count as independent experiments. Vendor claims, historical and disputed results are excluded from this overview and remain labelled in the detailed evidence.

7 measurements from these sources still lack a verified test-family identity and do not increase the test-series count.

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

AA-LCR: Overall (Show measurement, test conditions, and source)

Source value: 17
Score: 17
Metric: Pass rate
Unit: %
Benchmark version: v1.1
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-aa-lcr:v1.1:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 17.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning

Source Artificial Analysis

AutomationBench-AA: Overall (Show measurement, test conditions, and source)

Source value: 0.6658657772309807
Score: 0.6658657772309807
Metric: Objectives completed without guardrail violations
Unit: %
Benchmark version: unspecified
Category: agentic
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-automationbench-aa:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.7%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning

Source Artificial Analysis

CritPt: Overall (Show measurement, test conditions, and source)

Source value: 0
Score: 0
Metric: Score
Unit: %
Benchmark version: unspecified
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-critpt:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: disputed
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
Context: Artificial Analysis marks CritPt as under review; dataset revisions may change results.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.

Source Artificial Analysis

GDP.pdf: Overall (Show measurement, test conditions, and source)

Source value: 0
Score: 0
Metric: All-pass rate
Unit: %
Benchmark version: unspecified
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-gdp-pdf:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning

Source Artificial Analysis

Humanity's Last Exam: Overall (Show measurement, test conditions, and source)

Source value: 5.37534754402224
Score: 5.37534754402224
Metric: Text-only pass@1 accuracy
Unit: %
Benchmark version: unspecified
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-humanitys-last-exam:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 5.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
Context: Artificial Analysis describes this comparable run as 2,158 text-only questions, not the full 2,500-question dataset.

Source Artificial Analysis

IFBench: Overall (Show measurement, test conditions, and source)

Source value: 26.802721088435398
Score: 26.802721088435398
Metric: IFBench prompt-level loose accuracy (pass@1)
Unit: %
Benchmark version: AA test set: 294 questions
Category: general
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Score display: 26.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning
Context: The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.

Source Artificial Analysis

MMMU-Pro: Overall (Show measurement, test conditions, and source)

Source value: 38.092485549132896
Score: 38.092485549132896
Metric: pass@1 accuracy
Unit: %
Benchmark version: AA cohort: 1,730 questions
Category: multimodal
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning. Score display: 38.1%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning
Context: The benchmark page describes 3,460 questions in the full MMMU-Pro dataset; AA's methodology specifies a 1,730-question run.

Source Artificial Analysis

AA-Omniscience Accuracy: Overall (Show measurement, test conditions, and source)

Source value: 8.983333333333334
Score: 8.983333333333334
Metric: AA-Omniscience Accuracy
Unit: %
Benchmark version: AA Omniscience diagnostic
Category: knowledge
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-omniscience-accuracy:AA Omniscience diagnostic:standalone:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: non-reasoning. Score display: 9.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: non-reasoning
Context: This is the separately published accuracy diagnostic, not the AA-Omniscience Index. AA identifies higher values as better.

Source Artificial Analysis

AA-Omniscience Hallucination Rate: Overall (Show measurement, test conditions, and source)

Source value: 80.18677897820912
Score: 80.18677897820912
Metric: AA-Omniscience Hallucination Rate
Unit: %
Benchmark version: AA Omniscience diagnostic
Category: knowledge
Task: overall
Task label: Overall
Direction: Lower is better
Comparison cohort: artificial-analysis-omniscience-hallucination-rate:AA Omniscience diagnostic:standalone:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: non-reasoning. Score display: 80.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: non-reasoning
Context: This is the separately published hallucination-rate diagnostic, not the AA-Omniscience Index. AA identifies lower values as better.

Source Artificial Analysis

SciCode: Overall (Show measurement, test conditions, and source)

Source value: 15.277777777777802
Score: 15.277777777777802
Metric: SciCode score
Unit: %
Benchmark version: unspecified
Category: coding
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-scicode:unspecified:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: disputed
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 15.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning
Context: Artificial Analysis says SciCode is under review following an independent dataset audit.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.

Source Artificial Analysis

Terminal-Bench: Overall (Show measurement, test conditions, and source)

Source value: 0
Score: 0
Metric: Task success
Unit: %
Benchmark version: 4.0
Category: coding
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-terminal-bench-4:4.0:v4.3.2:non-reasoning:tokens=0:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720/ministral-3-3b/ministral-3-3b. Source model name: Ministral 3 3B. Provider reported by source: Mistral. Model snapshot: Ministral 3 3B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: non-reasoning. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Ministral 3 3B (release ministral-3-3b, row ministral-3-3b, UUID 66f4ce73-9a9b-4b49-9c6e-bedb9bfdc720, reasoning=false, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: non-reasoning

Source Artificial Analysis

WildBench (Show measurement, test conditions, and source)

Source value: 56.8
Score: 56.8
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Ministral 3 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; exact judge not stated

Source Ministral 3 model card

Page 1 of 3

Predecessor and successor

Predecessor: Ministral 3B (Official documentation)
Official documentation
Model lineage evidence
Mistral's official model lifecycle page lists Ministral 3B (API id ministral-3b-2410, released October 2024, retroactively called Ministral 1 - 3B in Mistral's separate AI-governance registry) as deprecated with a single named recommended replacement, Ministral 3 3B, matching this directory profile's release date of December 2, 2025.
Mistral AI model lifecycle table (Deprecated models section) (2026-09-19)

Sources and data date

Type	Evidence and data date
Speed	Mistral. Output speed after the first streaming chunk, not total response time. Retrieved September 8, 2026. Source: Artificial Analysis · Artificial Analysis (retrieved September 8, 2026)Speed measurement methodology
Price	Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs. Source: Pricing · API pricing
Input	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Ministral 3 3B model card · Editorial description reviewed October 2, 2026
Output	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Ministral 3 3B model card · Editorial description reviewed October 2, 2026
Research status	Research date September 8, 2026. 2 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not found in the inspected sources	knowledge-cutoff Original wording No exact cutoff in card.
Not found in the inspected sources	training-tokens Original wording No training-token count in card.
Not found in the inspected sources	max-output-tokens Original wording No model-specific maximum output stated.
Additional source	Context window data
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Mistral 3 announcement · Editorial description reviewed October 2, 2026
Additional source	Mistral model overview · Editorial description reviewed October 2, 2026
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Ollama: cumulative downloads for the popularity index
Additional source	Replicate: cumulative runs for the popularity index
Additional source	Google Trending Now: limited feed selection for Germany and the US
Additional source	Creative Commons Attribution 4.0