Skip to main content
Language modelActive

Phi-4

Microsoft

Released
December 2024
Data date
September 8, 2026
Speed
41.1 tokens/s
Output throughput
Price
Input · Output / 1M tokens
Input
Text
Output
Text

Phi-4 combines 14 billion dense parameters with a 16,384-token context. Microsoft trained the checkpoint on 9.8 trillion tokens, including a substantial share of synthetic and curated data. The weights use the MIT license.

Microsoft describes Phi-4 as a development of the Phi-3 line with only small architectural changes. The gains are attributed mainly to data mixture, curriculum, and post-training. The model card identifies English as the primary language.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Access
API, LocalSource
Parameters
Context window
16,384 tokensSource
Knowledge cutoff
June 2024Source
Notes
Trained on 9.8T tokens, excels at math/reasoningSource
License
Release
2024-12-12Source
Parameters
14 BSource
Knowledge cutoff
2024-06Source
Training tokens
9.8TSource
Architecture
dense decoder-only TransformerSource
Input
TextSource
Output
TextSource
Languages
EnglishSource