Language modelActive

Llama 3.1 70B

Specifications and access

Specification	Value and source
Weights	Open weightsSource not specified
Access	API, LocalSource
Parameters	70BSource not specified
Context window	131,072 tokensSource
Knowledge cutoff	December 2023Source
License	Llama 3.1 Community LicenseSource
Release	2024-07-23Source
Parameters	70 BSource
Architecture	dense transformerSource
Input	TextSource
Output	Text, codeSource
Languages	8Source
Training tokens	15T+Source
Knowledge cutoff	2023-12Source

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

MMLU instruct (Show measurement, test conditions, and source)

Source value: 83.6
Score: 83.6
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; 5-shot

Source Meta Llama 3.1 model card

MMLU CoT (Show measurement, test conditions, and source)

Source value: 86
Score: 86
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; CoT

Source Meta Llama 3.1 model card

MMLU Pro instruct (Show measurement, test conditions, and source)

Source value: 66.4
Score: 66.4
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

IFEval (Show measurement, test conditions, and source)

Source value: 87.5
Score: 87.5
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

ARC instruct (Show measurement, test conditions, and source)

Source value: 94.8
Score: 94.8
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

GPQA (Show measurement, test conditions, and source)

Source value: 46.7
Score: 46.7
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

HumanEval (Show measurement, test conditions, and source)

Source value: 80.5
Score: 80.5
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

MBPP (Show measurement, test conditions, and source)

Source value: 86
Score: 86
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

GSM8K (Show measurement, test conditions, and source)

Source value: 95.1
Score: 95.1
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table; CoT

Source Meta Llama 3.1 model card

MATH (Show measurement, test conditions, and source)

Source value: 68
Score: 68
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct table

Source Meta Llama 3.1 model card

API-Bank (Show measurement, test conditions, and source)

Source value: 90
Score: 90
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct tool-use table

Source Meta Llama 3.1 model card

BFCL (Show measurement, test conditions, and source)

Source value: 84.8
Score: 84.8
Metric: percent
Unit: %
Direction: Higher is better
Source type: vendor-reported
Evaluator: Meta Llama 3.1 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. Instruct tool-use table

Source Meta Llama 3.1 model card

Page 1 of 2

Predecessor and successor

Sources and data date

Type	Evidence and data date
Speed	Median across serving providers. Output speed after the first streaming chunk, not total response time. Classified as deprecated by Artificial Analysis. Artificial Analysis maintains only the default 10K-input workload there. Retrieved September 8, 2026. Source: Artificial Analysis · Artificial Analysis (retrieved September 8, 2026)Speed measurement methodology
Price	Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs. Source: Pricing · API pricing
Input	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Meta Llama 3.1 model card (retrieved September 8, 2026) · Meta Llama 3.1 model card · Editorial description reviewed October 4, 2026
Output	Documented modalities. Retrieved September 8, 2026. Source: Model documentation · Meta Llama 3.1 model card (retrieved September 8, 2026) · Meta Llama 3.1 model card · Editorial description reviewed October 4, 2026
Research status	Research date September 8, 2026. 2 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not found in the inspected sources	max-output-tokens Original wording No model-specific maximum output in the card.
Additional source	Context window data
Additional source	Knowledge cutoff data · Meta Llama model documentation · Editorial description reviewed October 4, 2026
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Creative Commons Attribution 4.0
Additional source	Meta, Llama-3.3-70B-Instruct model card (Hugging Face) (2026-09-19)

Llama 3.1 70B

Specifications and access

Measurements without matching peer values

Our tests

Pelican on a bicycle

Popularity

Published prices

Predecessor and successor

Sources and data date