Skip to main content

NVIDIALanguage model

Llama 3.3 Nemotron Super 49B v1

Llama 3.3 Nemotron Super 49B v1 has no overall index value yet because there are too few independent benchmark results.

PopularityRank 468 of 785

33out of 100-1 vs. last month

based on search, usage and attention

Summary

Llama 3.3 Nemotron Super 49B v1 is NVIDIA's post-trained Super variant built from Llama 3.3 70B Instruct. Neural Architecture Search reduces serving overhead without making the checkpoint small. Reasoning and direct responses remain distinct operating modes.

The model has 49 billion parameters and 131,072 context tokens for longer agent tasks. The open weights use NVIDIA's Open Model License. The exact v1 identity remains distinct. The later Llama 3.3 Nemotron Super 49B v1.5 is a revised checkpoint, not a simple rename.

All benchmark results

Every published result with its source, test setup and comparison models.

Show all 36 published benchmark results

Page 1 of 3

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

CritPt v2: Overall (Show measurement, test conditions, and source)
Source value
0
Score
0
Metric
pass@1 accuracy
Unit
%
Benchmark version
v2
Category
reasoning
Task
overall
Task label
Overall
Direction
Higher is better
Source type
independent-evaluator
Evaluator
Artificial Analysis
Status
disputed
Retrieved at
2026-11-02
Methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b-reasoning, UUID 1a8ba535-df18-459b-ad40-3199191296d7, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Source model ID: artificial-analysis/1a8ba535-df18-459b-ad40-3199191296d7/llama-3-3-nemotron-super-49b/llama-3-3-nemotron-super-49b-reasoning. Source model name: Llama 3.3 Nemotron Super 49B v1. Provider reported by source: NVIDIA. Model snapshot: Llama 3.3 Nemotron Super 49B v1 (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: reasoning enabled. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-critpt-v2:v2:standalone:reasoning:effort=unspecified:suffix=Reasoning
Comparison methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b-reasoning, UUID 1a8ba535-df18-459b-ad40-3199191296d7, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: reasoning enabled
Context
This AA source field contains the original CritPt score. The earlier CritPt v2 attribution was incorrect; the value and former label remain as disputed historical evidence.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.
Source Artificial Analysis
CritPt v2: Overall (Show measurement, test conditions, and source)
Source value
0
Score
0
Metric
pass@1 accuracy
Unit
%
Benchmark version
v2
Category
reasoning
Task
overall
Task label
Overall
Direction
Higher is better
Source type
independent-evaluator
Evaluator
Artificial Analysis
Status
disputed
Retrieved at
2026-11-02
Methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b, UUID c4c3b42f-e0f0-48ca-b6f9-b296e7697806, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Source model ID: artificial-analysis/c4c3b42f-e0f0-48ca-b6f9-b296e7697806/llama-3-3-nemotron-super-49b/llama-3-3-nemotron-super-49b. Source model name: Llama 3.3 Nemotron Super 49B v1. Provider reported by source: NVIDIA. Model snapshot: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: non-reasoning. Reasoning effort: none. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-critpt-v2:v2:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
Comparison methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b, UUID c4c3b42f-e0f0-48ca-b6f9-b296e7697806, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: non-reasoning. Reasoning effort: none
Context
This AA source field contains the original CritPt score. The earlier CritPt v2 attribution was incorrect; the value and former label remain as disputed historical evidence.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.
Source Artificial Analysis
IFBench: Overall (Show measurement, test conditions, and source)
Source value
38.0952380952381
Score
38.0952380952381
Metric
IFBench prompt-level loose accuracy (pass@1)
Unit
%
Benchmark version
AA test set: 294 questions
Category
general
Task
overall
Task label
Overall
Direction
Higher is better
Source type
independent-evaluator
Evaluator
Artificial Analysis
Status
superseded
Retrieved at
2026-11-02
Methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b-reasoning, UUID 1a8ba535-df18-459b-ad40-3199191296d7, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/1a8ba535-df18-459b-ad40-3199191296d7/llama-3-3-nemotron-super-49b/llama-3-3-nemotron-super-49b-reasoning. Source model name: Llama 3.3 Nemotron Super 49B v1. Provider reported by source: NVIDIA. Model snapshot: Llama 3.3 Nemotron Super 49B v1 (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Score display: 38.1%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:effort=unspecified:suffix=Reasoning
Comparison methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b-reasoning, UUID 1a8ba535-df18-459b-ad40-3199191296d7, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled
Context
The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.. This result is retained as historical evidence and is not interchangeable with current results.
Source Artificial Analysis
IFBench: Overall (Show measurement, test conditions, and source)
Source value
38.0952380952381
Score
38.0952380952381
Metric
IFBench prompt-level loose accuracy (pass@1)
Unit
%
Benchmark version
AA test set: 294 questions
Category
general
Task
overall
Task label
Overall
Direction
Higher is better
Source type
independent-evaluator
Evaluator
Artificial Analysis
Status
active
Retrieved at
2026-11-07
Methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b-reasoning, UUID 1a8ba535-df18-459b-ad40-3199191296d7, reasoning=true, effort=not specified, suffix=Reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/1a8ba535-df18-459b-ad40-3199191296d7/llama-3-3-nemotron-super-49b/llama-3-3-nemotron-super-49b-reasoning. Source model name: Llama 3.3 Nemotron Super 49B v1. Provider reported by source: NVIDIA. Model snapshot: Llama 3.3 Nemotron Super 49B v1 (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Score display: 38.1%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-07-b96e3ffc8c5b. Source payload hash: b96e3ffc8c5b052aa56f96d05e89d02b8cc234a75085820fca0ca2a39e498274. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-07. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:effort=unspecified:suffix=Reasoning
Comparison methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b-reasoning, UUID 1a8ba535-df18-459b-ad40-3199191296d7, reasoning=true, effort=not specified, suffix=Reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled
Context
The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.
Source Artificial Analysis
IFBench: Overall (Show measurement, test conditions, and source)
Source value
39.4557823129252
Score
39.4557823129252
Metric
IFBench prompt-level loose accuracy (pass@1)
Unit
%
Benchmark version
AA test set: 294 questions
Category
general
Task
overall
Task label
Overall
Direction
Higher is better
Source type
independent-evaluator
Evaluator
Artificial Analysis
Status
superseded
Retrieved at
2026-11-02
Methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b, UUID c4c3b42f-e0f0-48ca-b6f9-b296e7697806, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/c4c3b42f-e0f0-48ca-b6f9-b296e7697806/llama-3-3-nemotron-super-49b/llama-3-3-nemotron-super-49b. Source model name: Llama 3.3 Nemotron Super 49B v1. Provider reported by source: NVIDIA. Model snapshot: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none. Score display: 39.5%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
Comparison methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b, UUID c4c3b42f-e0f0-48ca-b6f9-b296e7697806, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none
Context
The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.. This result is retained as historical evidence and is not interchangeable with current results.
Source Artificial Analysis
IFBench: Overall (Show measurement, test conditions, and source)
Source value
39.4557823129252
Score
39.4557823129252
Metric
IFBench prompt-level loose accuracy (pass@1)
Unit
%
Benchmark version
AA test set: 294 questions
Category
general
Task
overall
Task label
Overall
Direction
Higher is better
Source type
independent-evaluator
Evaluator
Artificial Analysis
Status
active
Retrieved at
2026-11-07
Methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b, UUID c4c3b42f-e0f0-48ca-b6f9-b296e7697806, reasoning=false, effort=not specified, suffix=Non-reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/c4c3b42f-e0f0-48ca-b6f9-b296e7697806/llama-3-3-nemotron-super-49b/llama-3-3-nemotron-super-49b. Source model name: Llama 3.3 Nemotron Super 49B v1. Provider reported by source: NVIDIA. Model snapshot: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none. Score display: 39.5%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-07-b96e3ffc8c5b. Source payload hash: b96e3ffc8c5b052aa56f96d05e89d02b8cc234a75085820fca0ca2a39e498274. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-07. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
Comparison methodology
Exact AA configuration: Llama 3.3 Nemotron Super 49B v1 (Non-reasoning) (release llama-3-3-nemotron-super-49b, row llama-3-3-nemotron-super-49b, UUID c4c3b42f-e0f0-48ca-b6f9-b296e7697806, reasoning=false, effort=not specified, suffix=Non-reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none
Context
The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.
Source Artificial Analysis
Arena-Hard (Show measurement, test conditions, and source)
Source value
88.3
Score
88.3
Metric
unknown
Unit
No unit provided
Direction
Higher is better
Source type
vendor-reported
Evaluator
NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
Status
active
Retrieved at
2026-10-15
Methodology
Vendor-reported result. Exact v1 checkpoint; Reasoning Off; scores aggregated in NVIDIA's published evaluation results.
Source NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
MATH500 pass@1 reasoning on (Show measurement, test conditions, and source)
Source value
96.6
Score
96.6
Metric
pass@1
Unit
No unit provided
Benchmark version
MATH500
Direction
Higher is better
Source type
vendor-reported
Evaluator
NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
Status
active
Retrieved at
2026-10-15
Methodology
Vendor-reported result. Exact v1 checkpoint; reasoning on. Card says benchmark results use up to 16 runs, averaged; benchmark-specific run count is not stated here.
Source NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
AIME25 pass@1 reasoning on (Show measurement, test conditions, and source)
Source value
58.4
Score
58.4
Metric
pass@1
Unit
No unit provided
Benchmark version
AIME 2025
Direction
Higher is better
Source type
vendor-reported
Evaluator
NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
Status
active
Retrieved at
2026-10-15
Methodology
Vendor-reported result. Exact v1 checkpoint; reasoning on; card general evaluation uses temperature 0.6, top_p 0.95, 32K sequence length, and averages up to 16 runs.
Source NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
GPQA pass@1 reasoning on (Show measurement, test conditions, and source)
Source value
66.67
Score
66.67
Metric
pass@1
Unit
No unit provided
Benchmark version
GPQA
Direction
Higher is better
Source type
vendor-reported
Evaluator
NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
Status
active
Retrieved at
2026-10-15
Methodology
Vendor-reported result. Exact v1 checkpoint; reasoning on; general evaluation settings are temperature 0.6, top_p 0.95, 32K sequence length, with up to 16-run averages.
Source NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
IFEval strict instruction reasoning on (Show measurement, test conditions, and source)
Source value
89.21
Score
89.21
Metric
Strict:Instruction
Unit
No unit provided
Direction
Higher is better
Source type
vendor-reported
Evaluator
NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
Status
active
Retrieved at
2026-10-15
Methodology
Vendor-reported result. Exact v1 checkpoint; reasoning on; metric labeled Strict:Instruction; general table settings include 32K sequence length.
Source NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
BFCL V2 Live reasoning off (Show measurement, test conditions, and source)
Source value
73.7
Score
73.7
Metric
unknown
Unit
No unit provided
Direction
Higher is better
Source type
vendor-reported
Evaluator
NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card
Status
active
Retrieved at
2026-10-15
Methodology
Vendor-reported result. Exact v1 checkpoint; Reasoning Off; table score. Prompt template is included in the source card but not summarized here.
Source NVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card

Page 1 of 3

Popularity compared

How often the model is searched for, used and mentioned, compared with every model of its category.

Popularity index

The 100 most popular models of this category, 0 to 100, higher is more popular

20 of 101 models

As of November 2026 · Source: gradually.ai popularity index

Over time

Weekly values from October 18, 2026 to November 7, 2026

Llama 3.3 Nemotron Super 49B v1AREX-2 33Command A Plus 33Llama 3.1 405B Instruct 33Holo4-27B 33

Method changes in the timeline, a jump at these points is no market event:

  1. 1November 1, 2026: Value only with search or usage data, 30-day attention

What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.

All specifications

Architecture

Parameters
49 billion
Source: Parameters

Input and output

Context window
131,072 tokens
Source: Context window
Maximum output
131,072 tokens
Source: Maximum output
Inputs
Text
Source: Inputs
Outputs
Text
Source: Outputs
Reasoning
Yes
Source: Reasoning
Tool calling
Yes
Source: Tool calling

Watermarking and provenance

AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.

AI watermarking
Unknown
no source
Watermarking technique
Not known
no source

Licence and access

Weights
Open weights
Source: Weights
License
NVIDIA Open Model License
Source: License

Frequently asked questions about Llama 3.3 Nemotron Super 49B v1

How large is the context window of Llama 3.3 Nemotron Super 49B v1?

131,072 tokens. That is how much text Llama 3.3 Nemotron Super 49B v1 reads at once, about 200 A4 pages.

Page count as a rule of thumb from Artificial Analysis

Context windowTokens the model reads at once · higher is better
GLM-5.1200K
DeepSeek-V3 0324164K
Llama 3.3 Nemotron Super 49B v1Rank 94 of 103131K
GLM-4.5131K
GPT OSS 120B131K
DeepSeek-V3.2128K
DeepSeek-R1128K

Can I run Llama 3.3 Nemotron Super 49B v1 locally?

Yes, the weights are open.

Stated by NVIDIA

Open weights
yes
License
NVIDIA Open Model License
Parameters
49B
active per token
n/a

Sources and data date

Show all 17 sources

Benchmark sources at a glance

Which independent evaluators tested this model. This is coverage, not a quality ranking.

EvaluatorTest seriesComposite indicesRecorded active measurements
Artificial Analysis102
LMArena002

Without vendor claims and historical or disputed results; those stay labelled in the single values. 2 measurements are not yet assigned to a test series.

TypeEvidence and data date
Input

Documented modalities. Retrieved October 27, 2026.

Output

Documented modalities. Retrieved October 27, 2026.

Research statusResearch date October 15, 2026. 7 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not published

score-units-and-task-protocol

Note

The v1 card specifies global evaluation settings but leaves table score units and some benchmark-specific run details unstated.

Unresolved

IFEval mode

Original wording

The v1 model card labels its IFEval Strict:Instruction score of 89.21 as reasoning off, while a separate benchmark entry on the card labels the same score as reasoning on. The card does not explain the different mode labels.

Additional sourceArtificial Analysis (retrieved November 2, 2026)
Additional sourceArtificial Analysis (retrieved November 2, 2026; November 7, 2026)
Additional sourceNVIDIA Llama-3.3-Nemotron-Super-49B-v1 model card (retrieved October 15, 2026; October 17, 2026) · NVIDIA Llama 3.3 Nemotron Super v1 model card · Editorial description reviewed October 2, 2026
Additional sourceJudge’s Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreement (retrieved October 17, 2026)
Additional sourceJoshi et al., CultureGuard (2025), Table 4 (retrieved October 18, 2026)
Additional sourceOptimizing Length Compression in Large Reasoning Models, ACL 2026, Table 1 (retrieved October 18, 2026)
Additional sourceArena.ai Text Arena Overall leaderboard (retrieved October 23, 2026)
Additional sourceArena.ai Text Arena Longer Query leaderboard (retrieved October 23, 2026)
Additional sourceModel metadata (retrieved October 17, 2026)
Additional sourceNVIDIA Nemotron reasoning model overview · Editorial description reviewed October 2, 2026
Additional sourceOpenRouter: Popularity index (derived), CC BY 4.0
Additional sourceVercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional sourceOllama: cumulative downloads for the popularity index
Additional sourceReplicate: cumulative runs for the popularity index
Additional sourceGoogle Trending Now: limited feed selection for Germany and the US
Additional sourceCreative Commons Attribution 4.0