Skip to main content
Language model

Yi-34B

01.AI

Released
November 2023

Yi-34B is 01.AI’s earlier 34B base checkpoint. The official model card separates the base model from a separately instruction-tuned chat checkpoint. The base variant is intended as a versatile foundation for custom fine-tuning, while the chat version is adapted for conversation. Yi-34B is therefore a base model rather than a ready-made assistant.

Yi-34B has a 4,096-token context. Yi-1.5 34B updates the same family with additional pretraining and post-training, but it is a different checkpoint. Yi-34B also keeps base and chat weights separate.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Parameters
34 billionSource
Context window
4,096 tokensSource
License
Apache 2.0Source
Inputs
TextSource
Outputs
TextSource