Skip to main content
Language modelOpen weights

K2 Horizon 3.7B

Institute of Foundation Models

Released
September 3, 2026
Data date
October 7, 2026
Input
Text
Output
Text

K2 Horizon 3.7B brings the dense architecture to a smaller scale while retaining a native context of 524,288 tokens. Its published training path uses separate math, code, and STEM-code RL experts, merges their weights, and then applies FTPO as a final training stage.

Specifications and access

SpecificationValue and source
Parameters
3.7B total parametersSource
Active parameters
3.7B parameters per tokenSource
Context window
524,288 tokensSource
Input modalities
TextSource
Output modalities
TextSource
Documented training stages
Pretraining, four midtraining stages, math, code, and STEM-code RL experts with a merge, two SFT phases, and a final anti-doom-loop FTPO step.Source
License
Apache 2.0Source