Skip to main content
Language model

StarCoder2 15B

BigCode

Released
February 2024

StarCoder2 15B is BigCode’s code-completion model, not a general chat assistant. It was trained on more than 600 programming languages from The Stack v2 and more than 4 trillion tokens overall. With a 16,384-token context, 4,096-token sliding attention, and fill-in-the-middle support, it fits code completion, gap filling, and editor work across files.

The model card explicitly says direct instructions do not work well because the checkpoint is not instruction tuned. StarCoder2 15B is therefore built for completion and fill-in-the-middle rather than chat. BigCode also warns that generated code can reproduce material from the training data, and the OpenRAIL-M license is part of the published model identity.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Parameters
15 billionSource
Context window
16,384 tokensSource
License
BigCode Open RAIL-M v1Source
Inputs
TextSource
Outputs
TextSource