Skip to main content
Language model

Yi-1.5 34B

01.AI

Released
May 2024

Yi-1.5 34B is 01.AI’s updated 34B line. Its model card describes continued pretraining on 500 billion high-quality tokens and fine-tuning on 3 million examples. 01.AI says the process improves coding, mathematics, reasoning, and instruction following while preserving language understanding and common sense. Its context window is 4,096 tokens.

Compared with the older Yi-34B, Yi-1.5 34B is explicitly documented as an updated training stage. The Yi-1.5 family still has separate base and chat variants.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Parameters
34 billionSource
Context window
4,096 tokensSource
License
Apache 2.0Source
Inputs
TextSource
Outputs
TextSource