Skip to main content
Language modelOpen weights

K2 Horizon 375B-A23B

Institute of Foundation Models

Released
September 3, 2026
Data date
October 7, 2026
Input
Text
Output
Text

K2 Horizon 375B-A23B is the largest model in IFM’s open fleet. Its MoE architecture combines 375 billion total parameters and activates 23 billion per token. IFM also releases intermediate checkpoints from pretraining, midtraining, reinforcement learning, and SFT, making several stages of its development available for study.

Specifications and access

SpecificationValue and source
Parameters
375B total parametersSource
Active parameters
23B parameters per tokenSource
Context window
524,288 tokensSource
Input modalities
TextSource
Output modalities
TextSource
Documented training stages
Two pretraining phases, four midtraining stages, five RL experts followed by a merge, and three SFT phases.Source
License
Apache 2.0Source