Language model

DeepSeek LLM 67B

DeepSeek

Released: November 2023

Input: Text
Output: Text

DeepSeek LLM 67B Chat comes from DeepSeek’s 2023 LLM generation. Its 67 billion dense parameters and 4,096-token context window clearly separate it from the later V3 and R1 models.

The model card documents local text chat but neither multimodal input nor tool loops. The short context window remains this checkpoint’s central limitation.

Specifications and access

Specification	Value and source
Weights	Open weightsSource
Parameters	67 billionSource
Context window	4,096 tokensSource
License	DeepSeek LicenseSource
Inputs	TextSource
Outputs	TextSource

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

GSM8K CoT (Show measurement, test conditions, and source)

Source value: 84.1
Score: 84.1
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; Chain-of-Thought
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

MATH CoT (Show measurement, test conditions, and source)

Source value: 32.6
Score: 32.6
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; Chain-of-Thought
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

MGSM Chinese CoT (Show measurement, test conditions, and source)

Source value: 74
Score: 74
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; Chain-of-Thought
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

CMATH CoT (Show measurement, test conditions, and source)

Source value: 80.3
Score: 80.3
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; Chain-of-Thought
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

Gaokao Math Cloze CoT (Show measurement, test conditions, and source)

Source value: 16.9
Score: 16.9
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; Chain-of-Thought
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

Gaokao Math QA CoT (Show measurement, test conditions, and source)

Source value: 20.2
Score: 20.2
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; Chain-of-Thought
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

GSM8K tool-integrated reasoning (Show measurement, test conditions, and source)

Source value: 86.7
Score: 86.7
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; tool-integrated reasoning
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

MATH tool-integrated reasoning (Show measurement, test conditions, and source)

Source value: 51.1
Score: 51.1
Metric: accuracy
Unit: %
Benchmark version: DeepSeek 67B Chat; tool-integrated reasoning
Category: math
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.

Source DeepSeek LLM author evaluation appendix

Prompt-level Instruction Following (Show measurement, test conditions, and source)

Source value: 59.1
Score: 59.1
Metric: score
Unit: No unit provided
Benchmark version: DeepSeek LLM 67B Chat
Category: instruction-following
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.
Context: The source presents a raw score without an explicit unit or scale; the published value is retained without percentage conversion.

Source DeepSeek LLM author evaluation appendix

LeetCode Weekly Contest (Show measurement, test conditions, and source)

Source value: 17.5
Score: 17.5
Metric: score
Unit: No unit provided
Benchmark version: DeepSeek LLM 67B Chat
Category: coding
Direction: Higher is better
Source type: vendor-reported
Evaluator: DeepSeek LLM author evaluation appendix
Status: active
Retrieved at: 2026-10-15
Methodology: Vendor-reported result. Exact DeepSeek LLM 67B Chat model row/widget in DeepSeek LLM author evaluation appendix. Benchmark prompt, sampling/decoding settings, reasoning effort, quantization, and task run date are not stated in the cited result; none are inferred.
Context: The source presents a raw score without an explicit unit or scale; the published value is retained without percentage conversion.

Source DeepSeek LLM author evaluation appendix

Sources and data date

Type	Evidence and data date
Input	Documented modalities. Source: Hugging Face · Hugging Face · DeepSeek LLM 67B Chat model card · Editorial description reviewed October 2, 2026
Output	Documented modalities. Source: Hugging Face · Hugging Face · DeepSeek LLM 67B Chat model card · Editorial description reviewed October 2, 2026
Research status	Research date October 15, 2026. 1 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not published	benchmark-task-dates-and-non-math-units Note Math appendix explicitly labels percentages and distinguishes CoT from tool-integrated reasoning. Other table rows do not state run dates, scoring protocol, or units.
Additional source	DeepSeek LLM author evaluation appendix (retrieved October 15, 2026)
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Creative Commons Attribution 4.0

DeepSeek LLM 67B

Specifications and access

Measurements without matching peer values

Our tests

SVG short test

DeepSeek LLM 67B

Popularity

Sources and data date