Skip to main content
Language modelActive

Llama 3.2 1B

Meta

Released
September 25, 2024
Data date
September 8, 2026
Price
Input · Output / 1M tokens
Input
Text
Output
Text

Llama 3.2 1B was built through pruning and knowledge distillation. Meta used token probabilities from Llama 3.1 8B and 70B as training targets to recover performance after reducing the model. It is the smallest text checkpoint in the Llama 3.2 line.

Llama 3.2 3B was built with the same process as the larger variant. Both support 128K context tokens and use the Llama 3.2 Community License. Their knowledge cutoff is December 2023.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Access
API, LocalSource
Parameters
1.2BSource
Context window
131,072 tokensSource
Knowledge cutoff
December 2023Source
License
Llama 3.2 Community LicenseSource
Release
2024-10-24Source
Parameters
1.23 BSource
Architecture
dense transformerSource
Input
TextSource
Output
Text, codeSource
Languages
Training tokens
up to 9TSource
Knowledge cutoff
2023-12Source