Skip to main content
Language modelActive

DeepSeek-R1-Distill-Llama-70B

DeepSeek

Released
January 20, 2025
Data date
September 8, 2026
Speed
21.7 tokens/s
Output throughput
Price
Historical rates under Costs
Input
Text
Output
Text

What is distinctive about DeepSeek-R1-Distill-Llama-70B is the transfer of R1 reasoning patterns into a dense 70B checkpoint based on Llama 3.3 70B. The smaller local checkpoint does not inherit the mixture-of-experts architecture of DeepSeek-R1; it distills the original reasoning data instead.

DeepSeek-R1-Distill-Llama-70B is technically and legally separate from R1. Redistribution requires checking both the DeepSeek terms and the Llama license.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Access
LocalSource
Parameters
Context window
128,000 tokensSource
License
Parameters
70 BSource
Architecture
Llama 3.3 distilled reasoning modelSource
Context window
128,000 tokens (Context inherited from the R1 card; exact distilled tokenizer context not separately stated)Source
Reasoning mode
distilled reasoning modelSource