Language model

WizardLM-2 8x22B

Microsoft

Released: April 2024

Profile

Specifications and access

Published information about this model. Existing estimates are explicitly labeled.

Specification	Value and source
Weights	Open weightsSource
Access	APISource
Parameters	141 billionSource
Active parameters	39 billionSource
Context window	65,536 tokensSource
License	Apache 2.0Source
Inputs	TextSource
Outputs	TextSource