Skip to main content
Language modelActive

Solar Mini

Upstage

Released
January 2024
Data date
September 8, 2026
Price
Input · Output / 1M tokens
Input
Text
Output
Text

Solar Mini stands out through depth up-scaling rather than a simple increase in parameter count. Upstage enlarged a 32-layer Llama 2 structure, then added continued pretraining plus instruction and alignment tuning. The result is a compact text checkpoint with 10.7 billion parameters.

Upstage highlights retrieval-augmented generation with external documents. Its context window is 32,768 tokens.

Specifications and access

SpecificationValue and source
Weights
ProprietarySource
Access
Parameters
10.7BSource
Context window
32,768 tokensSource
Notes
Dense model with 10.7B parameters.Source
Release
2024-01 (Month-only precision; source did not expose an exact day.)Source
Architecture
32-layer Llama-2 architecture with depth up-scalingSource
Input
TextSource
Output
TextSource
Parameters
10.7 BSource