Skip to main content
Language model

Falcon 180B

TII

Released
September 2023
Input
Text
Output
Text

Falcon 180B remains a raw model for further fine-tuning, not a finished chat assistant. The dense decoder released by the Technology Innovation Institute in 2023 was trained on 3.5 trillion tokens from RefinedWeb and curated sources but has only a 2K context.

The official model card estimates about 400GB of memory for fast inference and recommends additional adaptation plus application safeguards. The Falcon-180B TII license contains its own acceptable-use rules.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Parameters
180 billionSource
Context window
2,048 tokensSource
License
Falcon LicenseSource
Inputs
TextSource
Outputs
TextSource