Language modelActive

DeepSeek-R1 0528

DeepSeek

Released: May 28, 2025
Data date: September 8, 2026
Predecessor: DeepSeek-R1

Benchmark-Meta-Score: Unavailable
Fewer than eight test series
Price: $0.5 · $2.18
Input · Output / 1M tokens

DeepSeek-R1 0528 is the revised reasoning release of the original R1. The mixture-of-experts checkpoint retains 671 billion total parameters and 37 billion active parameters but expands the context window to 163,840 tokens.

R1 0528 remains a separate checkpoint alongside DeepSeek-R1 and does not add a general non-thinking mode.

Specifications and access

Specification	Value and source
Weights	Open weightsSource
Access	API, LocalSource
Parameters	671BSource
Active parameters	37BSource
Context window	163,840 tokensSource
License	MITSource
Parameters	671 BSource
Active parameters	37 BSource
Rounded context label	128kSource
Model configuration context	163,840 tokens (Native checkpoint context; DeepSeek's API limit is a separate serving value.)Source
Architecture	MoE reasoning modelSource
Reasoning mode	reasoning model with improved function callingSource
Tool calling	YesSource

Benchmark meta-analysis

Overall and area scores

These Gradually indexes place selected published measurements on a 0 to 100 scale. They are not accuracy percentages and do not guarantee results in your application.

Retrieval dates of the sources used 2026-10-19 - 2026-10-19

Overall index

Not enough independent results for a score yet

An overall score needs at least eight test series.

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Test series: 1
Test families: 1 / 65
Sources: 1
Share of the fixed test panel (informative): 2 %

General

Index below 1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Standard error: ± 0.0
95% interval: 0.0 to 0.0
Test series: 1
Test families: 1 / 5
Sources: 1
Share of the fixed test panel (informative): 20 %

Documented method · Included test families and measurements

Method version: benchmark-meta-score-v3

The index includes active measurements from reviewed primary sources when at least five models are compared in the same documented comparison slice across dataset, harness, agent, tools, and trial count. Each benchmark series and evaluator contributes one shared setup slice from the newest capture. When one source and series include several explicitly documented reasoning tiers, the highest documented tier (none through max) is selected, never the best result value. The explicit source label “Non-reasoning” is treated as none. Unknown or ambiguous tiers exclude the model from that series. Within each series, percentages and rates are logit-transformed, other units stay unchanged, and all values are then standardized. A one-factor model then estimates one shared strength per model and, per series, how sharply it separates the models. Area scores move away from that strength only as far as the model's own results in the area support. The overall score weights the core areas at 75% and finance, law and health at 25%. It requires at least eight test series from two sources and three areas. The 0 to 100 scale refers to a fixed reference group of 29 language models whose average sits at 50.

Published model-specific parameters can differ. This is not a controlled experiment; comparisons with such differences are marked provisional.

Unmeasured series are not entered as zero. Where a model has no own results in a core area, its overall strength stands in, and the note “estimated without own results in …” names the area. Fewer test series lead to a larger standard error.

The 95% interval follows from the standard error of 200 recalculations with randomly redrawn test families. It describes how precisely the recorded test series determine the value. It is no prediction for future tasks or for later recalculations with other participants.

The source count is not a count of independent experiments.

OECD handbook on composite indicators

All 1 test families and 1 of 1 raw measurements are listed here. The complete calculation for every model is available in the JSON export.

Test family: IFBench
General · Mean rank percentile of the family: 27.5 / 100
Family weight in the fixed test panel (informative): 2.14 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-ifbench
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  2.14 %
  Raw value:
  39.5918367346939 %
  Metric:
  IFBench prompt-level loose accuracy (pass@1)
  Version:
  AA test set: 294 questions
  Participating models:
  70
  Rank percentile within the cohort:
  27.5 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:tokens=2000:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-ifbench","AA test set: 294 questions","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Tool policy:
  Single-turn answer evaluated with the official IFBench source code
  Attempts:
  pass@1, 5 repeats per question
  Setup and model parameters
  Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled
  Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/a83f84b3-473a-4276-9ae1-8909da723159/deepseek-r1/deepseek-r1. Source model name: DeepSeek-R1 0528. Provider reported by source: DeepSeek. Model snapshot: DeepSeek R1 0528 (May '25). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Score display: 39.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19

Benchmark sources at a glance

Each evaluator measures different capabilities under its own conditions. Test series, composite indices and their components stay separate. The detailed results below retain their scales, configurations and source dates.

Evaluator	Test series	Composite indices	Recorded active measurements
Artificial Analysis	2	0	3

Coverage is not a quality ranking. Overlapping tests and multiple settings do not count as independent experiments. Vendor claims, historical and disputed results are excluded from this overview and remain labelled in the detailed evidence.

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

IFBench: Overall (Show measurement, test conditions, and source)

Source value: 39.5918367346939
Score: 39.5918367346939
Metric: IFBench prompt-level loose accuracy (pass@1)
Unit: %
Benchmark version: AA test set: 294 questions
Category: general
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:tokens=2000:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/a83f84b3-473a-4276-9ae1-8909da723159/deepseek-r1/deepseek-r1. Source model name: DeepSeek-R1 0528. Provider reported by source: DeepSeek. Model snapshot: DeepSeek R1 0528 (May '25). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Score display: 39.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled
Context: The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.

Source Artificial Analysis

AA-Omniscience Accuracy: Overall (Show measurement, test conditions, and source)

Source value: 30.533333333333335
Score: 30.533333333333335
Metric: AA-Omniscience Accuracy
Unit: %
Benchmark version: AA Omniscience diagnostic
Category: knowledge
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-omniscience-accuracy:AA Omniscience diagnostic:standalone:reasoning:tokens=2000:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Source model ID: artificial-analysis/a83f84b3-473a-4276-9ae1-8909da723159/deepseek-r1/deepseek-r1. Source model name: DeepSeek-R1 0528. Provider reported by source: DeepSeek. Model snapshot: DeepSeek R1 0528 (May '25). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled. Score display: 30.5%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled
Context: This is the separately published accuracy diagnostic, not the AA-Omniscience Index. AA identifies higher values as better.

Source Artificial Analysis

AA-Omniscience Hallucination Rate: Overall (Show measurement, test conditions, and source)

Source value: 83.44529750479846
Score: 83.44529750479846
Metric: AA-Omniscience Hallucination Rate
Unit: %
Benchmark version: AA Omniscience diagnostic
Category: knowledge
Task: overall
Task label: Overall
Direction: Lower is better
Comparison cohort: artificial-analysis-omniscience-hallucination-rate:AA Omniscience diagnostic:standalone:reasoning:tokens=2000:suffix=unspecified
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Source model ID: artificial-analysis/a83f84b3-473a-4276-9ae1-8909da723159/deepseek-r1/deepseek-r1. Source model name: DeepSeek-R1 0528. Provider reported by source: DeepSeek. Model snapshot: DeepSeek R1 0528 (May '25). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled. Score display: 83.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: DeepSeek R1 0528 (May '25) (release deepseek-r1, row deepseek-r1, UUID a83f84b3-473a-4276-9ae1-8909da723159, reasoning=true, source reasoning-token configuration budget=2000, suffix=not specified). This configured value is not measured token consumption. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled
Context: This is the separately published hallucination-rate diagnostic, not the AA-Omniscience Index. AA identifies lower values as better.

Source Artificial Analysis

MMLU-Redux (Show measurement, test conditions, and source)

Source value: 93.4
Score: 93.4
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

MMLU-Pro (Show measurement, test conditions, and source)

Source value: 85
Score: 85
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

GPQA (Show measurement, test conditions, and source)

Source value: 81
Score: 81
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

SimpleQA (Show measurement, test conditions, and source)

Source value: 27.8
Score: 27.8
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

FRAMES (Show measurement, test conditions, and source)

Source value: 83
Score: 83
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

HLE (Show measurement, test conditions, and source)

Source value: 17.7
Score: 17.7
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

LiveCodeBench (Show measurement, test conditions, and source)

Source value: 73.3
Score: 73.3
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

SWE (Show measurement, test conditions, and source)

Source value: 57.6
Score: 57.6
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

Aider (Show measurement, test conditions, and source)

Source value: 71.6
Score: 71.6
Metric: percent
Unit: %
Category: mixed
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek R1-0528 model card
Status: active
Retrieved at: 2026-09-08
Methodology: Vendor-reported result. evaluation table; max context/output 64K, temperature .6, top_p .95, 16 responses; Agentless SWE

Source DeepSeek R1-0528 model card

Page 1 of 2

Predecessor and successor

Sources and data date

Type	Evidence and data date
Price	Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs. Source: Pricing · API pricing
Research status	Research date September 8, 2026. 4 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Unresolved	release-date Original wording No normalized release-date field in card.
Not found in the inspected sources	AA benchmark rows Original wording No exact-model row in the selected public JSON-LD datasets (some pages only expose N/A or unknown metric summaries).
Additional source	Model metadata
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	DeepSeek R1-0528 model card (retrieved September 8, 2026) · DeepSeek-R1 0528 model card · Editorial description reviewed October 2, 2026
Additional source	Model metadata (retrieved September 8, 2026) · DeepSeek-R1 0528 announcement · Editorial description reviewed October 2, 2026
Additional source	Model metadata (retrieved September 8, 2026) · DeepSeek-R1 0528 configuration · Editorial description reviewed October 2, 2026
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Ollama: cumulative downloads for the popularity index
Additional source	Replicate: cumulative runs for the popularity index
Additional source	Google Trending Now: limited feed selection for Germany and the US
Additional source	Creative Commons Attribution 4.0

DeepSeek-R1 0528

Specifications and access

Overall and area scores

Overall index

General

Test family: IFBench

Benchmark sources at a glance

Measurements without matching peer values

Our tests

SVG short test

DeepSeek-R1 0528

Pelican on a bicycle

Popularity

Published prices

Predecessor and successor

Sources and data date