Skip to main content
Language model

Falcon 3 7B

TII

Released
December 2024
Input
Text
Output
Text

Falcon 3 7B is TII’s compact open base checkpoint in the Falcon 3 family. According to the release post, it was pretrained in a large run on 14 trillion tokens from web, code, STEM, and multilingual data. The release presents it as a base model, while conversation and agent work require a separate instruction-tuned derivative.

Falcon 3 7B has a 32,768-token context. TII says Falcon 3 10B continues the same training line through depth upscaling, but it remains a separate 10B checkpoint. Both variants are base models without instruction post-training.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Parameters
7 billionSource
Context window
32,768 tokensSource
License
Falcon LicenseSource
Inputs
TextSource
Outputs
TextSource