Skip to main content
Language model

Llama 3.1 Nemotron Ultra 253B

NVIDIA

Released
April 7, 2025
Data date
September 26, 2026

Llama 3.1 Nemotron Ultra 253B CPT v1 is an NVIDIA base model derived from Llama 3.1 405B Instruct and then continually pretrained. The model card names English and coding languages as its main intended uses. The reasoning checkpoint built on top of it, Llama 3.1 Nemotron Ultra 253B v1, remains a separate model identity and is linked there as a preview API.

The CPT v1 checkpoint has 253 billion parameters, supports up to 131,072 context tokens, and produces text. The open weights use NVIDIA's Open Model License. This base model is intended for further adaptation, not as a finished reasoning chatbot.

Specifications and access

SpecificationValue and source
Weights
Open weightsSource
Access
Parameters
253 billionSource
License
NVIDIA Open Model LicenseSource
Inputs
TextSource
Outputs
TextSource
Reasoning
Tool calling
Context window
131,072 tokensSource