Granite 4.2 8B
API request failed. The model was not evaluated.
IBMLanguage modelOpen weights
Granite 4.2 8B
Granite 4.2 8B has no overall index value yet because there are too few independent benchmark results.
Intelligencenot ranked yet
n/aOverall indexhigher is better
SpeedRank 71 of 101
64Tokens per secondhigher is better
Priceno API price
n/aper 1M tokenslower is better
Contextn/a
n/atokens at once
PopularityRank 82 of 875
53out of 100same as last month
Summary
At 64 tokens per second it writes slower than a typical model (87).
For Granite 4.2 8B, IBM adds agent tasks in real coding, terminal, and search environments to foundational training. This block distinguishes 8B from Granite 4.2 3B. It trains multi-step tool use against the task’s actual outcome.
The dense 8-billion-parameter checkpoint sits between 3B and 30B. Its weights use Apache 2.0.
See for yourself: one prompt, one attempt
SVG short test
One SVG task with the same fixed settings for every model, without hidden thinking.
Earlier tests
Output withheld for safety
Pelican on a bicycle
Prompt
Generate an SVG of a pelican riding a bicycle
Oct 5, 2026 · 19 s · $0.0003
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Test details
- Run date
- Oct 5, 2026
- API provider
- openrouter
- Requested API model
- ibm-granite/granite-4.2-8b
- Reasoning setting
- high
- Token limit including reasoning
- 8,192 tokens
- Output tokens
- 1,925 tokens
- Cost of the attempt
- $0.0003
- Response time
- 19 s
- API model reported in response
- ibm-granite/granite-4.2-8b
- Pinned endpoint
- CoreWeave | ibm-granite/granite-4.2-8b-20260831
- Temperature
- Provider default
- Test protocol
- community-visual-tests-v1
- Technical checks
- Failed
All benchmark results
Every published result with its source, test setup and comparison models.
Show all 84 published benchmark results
Page 1 of 7
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
AutomationBench-AA: Overall (Show measurement, test conditions, and source)
- Source value
- 2.057126269200458
- Score
- 2.057126269200458
- Metric
- Objectives completed without guardrail violations
- Unit
- %
- Benchmark version
- AA private 657-task split of AutomationBench v1.0.6
- Category
- agentic
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 2.1%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-automationbench-aa:AA private 657-task split of AutomationBench v1.0.6:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
CritPt v2 (Hard Subset): Overall (Show measurement, test conditions, and source)
- Source value
- 0
- Score
- 0
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- v2 hard subset, November 2026 grading
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-critpt-v2-hard-subset:v2 hard subset, November 2026 grading:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
- Context
- This is the 40-question hard subset of CritPt v2, not the full 70-question CritPt v2 run.
CritPt v2: Overall (Show measurement, test conditions, and source)
- Source value
- 0.28571428571428603
- Score
- 0.28571428571428603
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- v2
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- disputed
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: reasoning enabled. Score display: 0.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-critpt-v2:v2:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: reasoning enabled
- Context
- This AA source field contains the original CritPt score. The earlier CritPt v2 attribution was incorrect; the value and former label remain as disputed historical evidence.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.
FrontierCode: Overall (Show measurement, test conditions, and source)
- Source value
- 0
- Score
- 0
- Metric
- Mean score over three attempts per task
- Unit
- %
- Benchmark version
- 2.0
- Category
- coding
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-frontiercode-2-0:2.0:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
GDP.pdf: Overall (Show measurement, test conditions, and source)
- Source value
- 0.6
- Score
- 0.6
- Metric
- All-pass rate
- Unit
- %
- Benchmark version
- unspecified
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 0.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-gdp-pdf:unspecified:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
HLE-Diamond: Overall (Show measurement, test conditions, and source)
- Source value
- 4
- Score
- 4
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- Diamond
- Category
- general
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 4.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-hle-diamond:Diamond:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
AA-Omniscience Accuracy: Overall (Show measurement, test conditions, and source)
- Source value
- 11.766666666666667
- Score
- 11.766666666666667
- Metric
- AA-Omniscience Accuracy
- Unit
- %
- Benchmark version
- AA Omniscience diagnostic
- Category
- knowledge
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled. Score display: 11.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-omniscience-accuracy:AA Omniscience diagnostic:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled
- Context
- This is the separately published accuracy diagnostic, not the AA-Omniscience Index. AA identifies higher values as better.. This result is retained as historical evidence and is not interchangeable with current results.
AA-Omniscience Accuracy: Overall (Show measurement, test conditions, and source)
- Source value
- 11.766666666666667
- Score
- 11.766666666666667
- Metric
- AA-Omniscience Accuracy
- Unit
- %
- Benchmark version
- AA Omniscience diagnostic
- Category
- knowledge
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled. Score display: 11.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-omniscience-accuracy:AA Omniscience diagnostic:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count. Proportion of all questions answered correctly, regardless of whether the model answers or abstains on other questions.. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled
- Context
- This is the separately published accuracy diagnostic, not the AA-Omniscience Index. AA identifies higher values as better.
AA-Omniscience Hallucination Rate: Overall (Show measurement, test conditions, and source)
- Source value
- 32.22516055912353
- Score
- 32.22516055912353
- Metric
- AA-Omniscience Hallucination Rate
- Unit
- %
- Benchmark version
- AA Omniscience diagnostic
- Category
- knowledge
- Task
- overall
- Task label
- Overall
- Direction
- Lower is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled. Score display: 32.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-omniscience-hallucination-rate:AA Omniscience diagnostic:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled
- Context
- This is the separately published hallucination-rate diagnostic, not the AA-Omniscience Index. AA identifies lower values as better.. This result is retained as historical evidence and is not interchangeable with current results.
AA-Omniscience Hallucination Rate: Overall (Show measurement, test conditions, and source)
- Source value
- 32.22516055912353
- Score
- 32.22516055912353
- Metric
- AA-Omniscience Hallucination Rate
- Unit
- %
- Benchmark version
- AA Omniscience diagnostic
- Category
- knowledge
- Task
- overall
- Task label
- Overall
- Direction
- Lower is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled. Score display: 32.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-omniscience-hallucination-rate:AA Omniscience diagnostic:standalone:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count. Proportion of incorrect answers among all non-correct responses: incorrect / (incorrect + partial answers + not attempted).. Attempts: AA-reported aggregate; diagnostic-specific run count is not stated on the leaderboard. Reasoning: reasoning enabled
- Context
- This is the separately published hallucination-rate diagnostic, not the AA-Omniscience Index. AA identifies lower values as better.
Terminal-Bench: Overall (Show measurement, test conditions, and source)
- Source value
- 0
- Score
- 0
- Metric
- Task success
- Unit
- %
- Benchmark version
- 4.0
- Category
- coding
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-terminal-bench-4:4.0:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
Terminal-Bench-Science: Overall (Show measurement, test conditions, and source)
- Source value
- 0
- Score
- 0
- Metric
- pass@1 task success rate
- Unit
- %
- Benchmark version
- 0.1.0
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-06
- Methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Source model ID: artificial-analysis/adfae555-f489-4f3e-9064-c6b7fcdd0783/granite-4-2-8b/granite-4-2-8b. Source model name: Granite 4.2 8B. Provider reported by source: IBM. Model snapshot: Granite 4.2 8B. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 0.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-06-ec1194e008b3. Source payload hash: ec1194e008b3638ef60dbf5249daf9e6047364e22905e745a4af64c5f3f080fe. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-06. Source cohort: artificial-analysis-terminal-bench-science:0.1.0:v5.0.1:reasoning:effort=unspecified:suffix=unspecified
- Comparison methodology
- Exact AA configuration: Granite 4.2 8B (release granite-4-2-8b, row granite-4-2-8b, UUID adfae555-f489-4f3e-9064-c6b7fcdd0783, reasoning=true, effort=not specified, suffix=not specified). This source capture does not provide an average reasoning-token count.. Reasoning: reasoning enabled
Page 1 of 7
Popularity compared
How often the model is searched for, used and mentioned, compared with every model of its category.
Popularity index
The 100 most popular models of this category, 0 to 100, higher is more popular
20 of 100 models
Gemini 4 Argon, Google DeepMind: 92
GPT-6 Astra, OpenAI: 78
Claude Haiku 5.5, Anthropic: 77
Qwen3.5 4B, Alibaba: 76
GPT-5, OpenAI: 73
GPT-6 Sol, OpenAI: 72
Qwen3.5 0.8B, Alibaba: 72
Qwen3.5 2B, Alibaba: 71
Qwen 3.8 27B, Alibaba: 70
Claude Opus 5.5, Anthropic: 70
DeepSeek V4.1 Flash 1017, DeepSeek: 68
Qwen 3.8 Max 0902, Alibaba: 68
Kimi K3, Moonshot AI: 68
DeepSeek-V4-Flash, DeepSeek: 65
GPT-5.6 Terra, OpenAI: 64
Claude Sonnet 5, Anthropic: 63
DiffusionGemma 26B A4B IT, Google: 63
Claude Opus 5, Anthropic: 62
Qwen 3.8 Flash, Alibaba: 62
Granite 4.2 8B, IBM: 53
As of November 2026 · Source: gradually.ai popularity index
Over time
Weekly values from October 18, 2026 to November 5, 2026
Granite 4.2 8BMagistral SmallGPT-6 LunaNemotron 3 UltraNemotron 3.5 Super VL 120B A12B
All specifications
Architecture
Watermarking and provenance
AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.
- AI watermarking
- Unknown
- no source
- Watermarking technique
- Not known
- no source
Licence and access
Prices
Not included in any subscription in Germany.
Frequently asked questions about Granite 4.2 8B
How fast is Granite 4.2 8B?
64 tokens per second. That is slower than a typical model at 87.
Measured by Artificial Analysis on Nov 6, 2026. AA 3.0.0, including time to first token, averaged across available workloads and five days.
Claude Opus 566
Granite 4.2 8BRank 71 of 10164
Claude Opus 4.564
GPT-5.464
GLM-5.363
GLM-562
Claude Sonnet 4.660
Can I run Granite 4.2 8B locally?
Yes, the weights are open.
Stated by IBM
- Open weights
- yes
- License
- Apache 2.0
- Parameters
- 8B
- active per token
- n/a
Sources and data date
Show all 30 sources
Benchmark sources at a glance
Which independent evaluators tested this model. This is coverage, not a quality ranking.
| Evaluator | Test series | Composite indices | Recorded active measurements |
|---|---|---|---|
| Artificial Analysis | 10 | 1 | 13 |
Without vendor claims and historical or disputed results; those stay labelled in the single values.
| Type | Evidence and data date |
|---|---|
| Speed | IBM, Reasoning enabled; effort unspecified. AA 3.0.0, including time to first token, averaged across available workloads and five days. Retrieved November 6, 2026. |
| Research status | Research date October 4, 2026. 11 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication. |
| Not published | sample-count-and-confidence-interval Original wording AA publishes neither a per-profile total executed N nor a confidence interval for this aggregate index. Methodology component task counts are not this model's measured N. |
| Unresolved | immutable-model-revision-and-reasoning-effort Original wording The page names the weights repository but no immutable commit or served revision, and does not disclose model-side reasoning effort. |
| Not published | immutable model repository and revision Original wording The paper names Granite-4.2-8B but does not identify an immutable model repository commit or weight hash. |
| Not published | confidence interval and repeated runs Original wording Table 2 says the Granite-as-student vanilla cell is a single run on each suite; no confidence interval or replicate distribution is reported. |
| Additional source | IBM Granite 4.2 announcement (retrieved October 3, 2026) · IBM Granite 4.2 announcement · Editorial description reviewed October 4, 2026 |
| Additional source | IBM Granite 4.2 technical report (retrieved October 4, 2026) · IBM Granite 4.2 technical report · Editorial description reviewed October 4, 2026 |
| Additional source | Artificial Analysis (retrieved November 6, 2026)12345678 |
| Additional source | Artificial Analysis (retrieved November 2, 2026) |
| Additional source | Artificial Analysis (retrieved October 29, 2026; November 2, 2026; November 6, 2026) |
| Additional source | Artificial Analysis (retrieved October 17, 2026; November 6, 2026) |
| Additional source | Artificial Analysis (retrieved November 2, 2026; November 6, 2026) |
| Additional source | IBM Granite 4.2 model card (retrieved October 17, 2026) |
| Additional source | Compiling Expert Procedures into Verified Programs, arXiv:2610.19148v1, Table 2 (retrieved October 17, 2026) |
| Additional source | Compiling Expert Procedures into Verified Programs: When a Small Model Is Enough (arXiv:2610.19148v1) (retrieved October 17, 2026; October 18, 2026) |
| Additional source | SpeciEval (retrieved October 19, 2026) |
| Additional source | IBM Granite product page (retrieved October 19, 2026) |
| Additional source | Michael Mulqueen (retrieved October 19, 2026) |
| Additional source | DuelLab GameBench 2 model results (retrieved October 20, 2026; October 28, 2026; November 2, 2026; November 5, 2026) |
| Additional source | Model metadata (retrieved October 17, 2026) |
| Additional source | OpenRouter: Popularity index (derived), CC BY 4.0 |
| Additional source | Vercel AI Gateway: Popularity index (derived), CC BY 4.0 |
| Additional source | Ollama: cumulative downloads for the popularity index |
| Additional source | Replicate: cumulative runs for the popularity index |
| Additional source | Google Trending Now: limited feed selection for Germany and the US |
| Additional source | Creative Commons Attribution 4.0 |