Skip to main content
Language model

Phi-4-mini

microsoft

Released
December 11, 2024
Data date
September 26, 2026

New in Phi-4-mini are a vocabulary enlarged to about 200,000 tokens, grouped-query attention, and shared input and output embeddings. Microsoft lists 23 supported languages. The open 3.8B instruction checkpoint has a 128K-token context and was trained with synthetic and filtered public data, SFT, and DPO.

Microsoft warns that the 3.8B model has limited factual knowledge.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Access
Parameters
3.8 billionSource
Context window
128,000 tokensSource
Maximum output
4,096 tokensSource
Knowledge Cutoff
October 2023Source
License
Inputs
TextSource
Outputs
TextSource
Tool calling