Skip to main content
Language modelOpen weights

Spark-X2.5-4B

iFLYTEK (SparkLLM Team)

Released
September 1, 2026
Data date
October 7, 2026
Input
Text
Output
Text

Spark-X2.5-4B uses hybrid attention, alternating one full-attention layer with three sliding-window layers. The open 4B edge checkpoint combines local attention with a native context window of 1,048,576 tokens.

Specifications and access

SpecificationValue and source
Parameters
4B parametersSource
Context window
1,048,576 tokens in the model configurationSource
Input modalities
TextSource
Output modalities
TextSource
Training stage
Post-trained checkpoint; the model card names large-scale reinforcement learning and MOPD.Source
License
Apache 2.0Source