Allen InstituteLanguage model
OLMo 2 13B
OLMo 2 13B has no overall index value yet because there are too few independent benchmark results.
28out of 100same as last month
based on search, usage and attention
Summary
OLMo 2 13B is Allen AI’s fully open research checkpoint, not just a downloadable set of weights. Alongside the models, Allen AI releases training code, checkpoints, logs, and details about data preparation. The model card says the 13B checkpoint was trained on 5 trillion tokens and deliberately keeps a 4,096-token context.
The OLMo 2 release includes base, SFT, DPO, and RLVR variants. OLMo 2 13B belongs to the 1124 release, while OLMo 2 32B belongs to the later 0325 release. Both checkpoints remain limited to a 4,096-token context.
All benchmark results
Every published result with its source, test setup and comparison models.
Show all 10 published benchmark results
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
OLMES MMLU (Show measurement, test conditions, and source)
- Source value
- 67.5
- Score
- 67.5
- Metric
- accuracy
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Test; 14,042 items; 5-shot; char normalization; MCF only.
OLMES ARC-Challenge (Show measurement, test conditions, and source)
- Source value
- 83.5
- Score
- 83.5
- Metric
- accuracy
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Test; 1,172 items; 5-shot; PMI normalization.
OLMES HellaSwag (Show measurement, test conditions, and source)
- Source value
- 86.4
- Score
- 86.4
- Metric
- accuracy
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Validation; 1,000 sampled from 10,042; 5-shot; char normalization.
OLMES WinoGrande (Show measurement, test conditions, and source)
- Source value
- 81.5
- Score
- 81.5
- Metric
- accuracy
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Validation; 1,267 items; 5-shot; no normalization.
OLMES Natural Questions (Show measurement, test conditions, and source)
- Source value
- 46.7
- Score
- 46.7
- Metric
- F1
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Validation; 1,000 sampled from 3,610; 5-shot.
OLMES DROP (Show measurement, test conditions, and source)
- Source value
- 70.7
- Score
- 70.7
- Metric
- F1
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Validation; 1,000 sampled from 9,536; 5-shot.
OLMES AGIEval English (Show measurement, test conditions, and source)
- Source value
- 54.2
- Score
- 54.2
- Metric
- MCF accuracy
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Test; 2,646 items; 1-shot; held-out.
OLMES GSM8K (Show measurement, test conditions, and source)
- Source value
- 75.1
- Score
- 75.1
- Metric
- exact match
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Test; 1,319 items; 8-shot CoT; held-out.
OLMES MMLU-Pro (Show measurement, test conditions, and source)
- Source value
- 35.1
- Score
- 35.1
- Metric
- MCF accuracy
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Test; 12,032 items; 5-shot; held-out.
OLMES TriviaQA (Show measurement, test conditions, and source)
- Source value
- 81.9
- Score
- 81.9
- Metric
- F1
- Unit
- %
- Benchmark version
- OLMES Table 6 / Appendix A.1 (report v3 2025-10-08)
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Allen Institute for AI OLMo 2 technical report
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Independent evaluation. OLMo 2 13B base-model row in Table 6 of report v3 (2025-10-08), evaluated with OLMES. Report defines multiple-choice scores as accuracy and generative scores as F1. Appendix A.1 supplies splits and shots. Exact base checkpoint only; no Instruct results transferred.; Validation; 7,993 items; 5-shot; held-out.
Popularity compared
How often the model is searched for, used and mentioned, compared with every model of its category.
Popularity index
The 100 most popular models of this category, 0 to 100, higher is more popular
20 of 101 models
As of November 2026 · Source: gradually.ai popularity index
Over time
Weekly values from October 18, 2026 to November 7, 2026
OLMo 2 13BTrinity Large Thinking 28GLM-4.7-FlashX 28MiMo-V2.5-Pro-UltraSpeed 28Nex-N2.5-Max 28
Method changes in the timeline, a jump at these points is no market event:
- 1November 1, 2026: Value only with search or usage data, 30-day attention
What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.
Similar models
More models of the same kind as OLMo 2 13B, chosen by model line, developer, size, price and release date.
All specifications
Architecture
Input and output
Watermarking and provenance
AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.
- AI watermarking
- Unknown
- no source
- Watermarking technique
- Not known
- no source
Licence and access
Frequently asked questions about OLMo 2 13B
How large is the context window of OLMo 2 13B?
4,096 tokens. That is how much text OLMo 2 13B reads at once, about 10 A4 pages.
Page count as a rule of thumb from Artificial Analysis
Can I run OLMo 2 13B locally?
Yes, the weights are open.
Stated by Allen Institute
- Open weights
- yes
- License
- Apache 2.0
- Parameters
- 13B
- active per token
- n/a
Sources and data date
Show all 9 sources
Benchmark sources at a glance
Which independent evaluators tested this model. This is coverage, not a quality ranking.
No active result from the reviewed external evaluators can currently be attributed to this model. Other source evidence remains available below.
Without vendor claims and historical or disputed results; those stay labelled in the single values.
| Type | Evidence and data date |
|---|---|
| Input | Documented modalities. |
| Output | Documented modalities. |
| Research status | Research date October 15, 2026. 1 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication. |
| Additional source | Allen Institute for AI OLMo 2 technical report (retrieved October 15, 2026) |
| Additional source | OLMo 2 technical report · Editorial description reviewed October 2, 2026 |
| Additional source | OpenRouter: Popularity index (derived), CC BY 4.0 |
| Additional source | Vercel AI Gateway: Popularity index (derived), CC BY 4.0 |
| Additional source | Ollama: cumulative downloads for the popularity index |
| Additional source | Replicate: cumulative runs for the popularity index |
| Additional source | Google Trending Now: limited feed selection for Germany and the US |
| Additional source | Creative Commons Attribution 4.0 |