GoogleLanguage model
Gemma 4 E4B IT
Gemma 4 E4B IT has no overall index value yet because there are too few independent benchmark results. From the vendor-reported results we estimate about 43.8 points (95% range 23.6 to 64.1). This is not an independent measurement.
Intelligencenot ranked yet
n/aOverall indexhigher is better
SpeedRank 81 of 101
52Tokens per secondhigher is better
Priceno API price
n/aper 1M tokenslower is better
ContextRank 94 of 103
131Ktokens at once≈ 200 A4 pages
PopularityRank 157 of 785
46out of 100same as last month
based on search, usage and attention
Summary
At 52 tokens per second it writes slower than a typical model (87).
Google Gemma 4 E4B IT is distinguished by the middle E variant with roughly 4.5 billion effective parameters and 8 billion including embeddings. It sits above Gemma 4 E2B IT without reaching the size of the 12B or 31B variants.
Google documents a 131,072-token context with text, image, and audio input, and the weights use Apache 2.0.
All benchmark results
Every published result with its source, test setup and comparison models.
Show all 96 published benchmark results
Page 1 of 8
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
CritPt v2: Overall (Show measurement, test conditions, and source)
- Source value
- 0.28571428571428603
- Score
- 0.28571428571428603
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- v2
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- disputed
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Source model ID: artificial-analysis/5303601c-8133-4f52-bc4e-5241ee6b3c10/gemma-4-e4b/gemma-4-e4b-non-reasoning. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: non-reasoning. Reasoning effort: none. Score display: 0.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-critpt-v2:v2:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: non-reasoning. Reasoning effort: none
- Context
- This AA source field contains the original CritPt score. The earlier CritPt v2 attribution was incorrect; the value and former label remain as disputed historical evidence.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.
CritPt v2: Overall (Show measurement, test conditions, and source)
- Source value
- 0.571428571428571
- Score
- 0.571428571428571
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- v2
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- disputed
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Source model ID: artificial-analysis/d80eb0f1-f62e-4d31-99d2-7a925eb126b0/gemma-4-e4b/gemma-4-e4b. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: reasoning enabled. Score display: 0.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-critpt-v2:v2:standalone:reasoning:effort=unspecified:suffix=Reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The full CritPt v2 run covers 70 questions with five repeats. The official grading server reports pass@1.. Tool policy: Python functions, symbolic expressions, and numerical answers; official grading server. Attempts: 70 questions, five repeats per question, pass@1. Reasoning: reasoning enabled
- Context
- This AA source field contains the original CritPt score. The earlier CritPt v2 attribution was incorrect; the value and former label remain as disputed historical evidence.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.
IFBench: Overall (Show measurement, test conditions, and source)
- Source value
- 40.5442176870748
- Score
- 40.5442176870748
- Metric
- IFBench prompt-level loose accuracy (pass@1)
- Unit
- %
- Benchmark version
- AA test set: 294 questions
- Category
- general
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/5303601c-8133-4f52-bc4e-5241ee6b3c10/gemma-4-e4b/gemma-4-e4b-non-reasoning. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none. Score display: 40.5%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none
- Context
- The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.. This result is retained as historical evidence and is not interchangeable with current results.
IFBench: Overall (Show measurement, test conditions, and source)
- Source value
- 40.5442176870748
- Score
- 40.5442176870748
- Metric
- IFBench prompt-level loose accuracy (pass@1)
- Unit
- %
- Benchmark version
- AA test set: 294 questions
- Category
- general
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-07
- Methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/5303601c-8133-4f52-bc4e-5241ee6b3c10/gemma-4-e4b/gemma-4-e4b-non-reasoning. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none. Score display: 40.5%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-07-b96e3ffc8c5b. Source payload hash: b96e3ffc8c5b052aa56f96d05e89d02b8cc234a75085820fca0ca2a39e498274. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-07. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: non-reasoning. Reasoning effort: none
- Context
- The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.
IFBench: Overall (Show measurement, test conditions, and source)
- Source value
- 44.2176870748299
- Score
- 44.2176870748299
- Metric
- IFBench prompt-level loose accuracy (pass@1)
- Unit
- %
- Benchmark version
- AA test set: 294 questions
- Category
- general
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/d80eb0f1-f62e-4d31-99d2-7a925eb126b0/gemma-4-e4b/gemma-4-e4b. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Score display: 44.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:effort=unspecified:suffix=Reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled
- Context
- The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.. This result is retained as historical evidence and is not interchangeable with current results.
IFBench: Overall (Show measurement, test conditions, and source)
- Source value
- 44.2176870748299
- Score
- 44.2176870748299
- Metric
- IFBench prompt-level loose accuracy (pass@1)
- Unit
- %
- Benchmark version
- AA test set: 294 questions
- Category
- general
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-07
- Methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/d80eb0f1-f62e-4d31-99d2-7a925eb126b0/gemma-4-e4b/gemma-4-e4b. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Score display: 44.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-07-b96e3ffc8c5b. Source payload hash: b96e3ffc8c5b052aa56f96d05e89d02b8cc234a75085820fca0ca2a39e498274. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-07. Source cohort: artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:effort=unspecified:suffix=Reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). This source capture does not provide an average reasoning-token count. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled
- Context
- The often cited 58 refers to verifiable out-of-domain constraint types, not the number of questions in AA's test run.
MMMU-Pro: Overall (Show measurement, test conditions, and source)
- Source value
- 51.2138728323699
- Score
- 51.2138728323699
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- AA cohort: 1,730 questions
- Category
- multimodal
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/5303601c-8133-4f52-bc4e-5241ee6b3c10/gemma-4-e4b/gemma-4-e4b-non-reasoning. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning. Reasoning effort: none. Score display: 51.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). AA marks this model variant as non-reasoning and reports 0 reasoning tokens. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning. Reasoning effort: none
- Context
- The benchmark page describes 3,460 questions in the full MMMU-Pro dataset; AA's methodology specifies a 1,730-question run.. This result is retained as historical evidence and is not interchangeable with current results.
MMMU-Pro: Overall (Show measurement, test conditions, and source)
- Source value
- 51.2138728323699
- Score
- 51.2138728323699
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- AA cohort: 1,730 questions
- Category
- multimodal
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-07
- Methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). This source capture does not provide an average reasoning-token count. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/5303601c-8133-4f52-bc4e-5241ee6b3c10/gemma-4-e4b/gemma-4-e4b-non-reasoning. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Non-reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning. Reasoning effort: none. Score display: 51.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-07-b96e3ffc8c5b. Source payload hash: b96e3ffc8c5b052aa56f96d05e89d02b8cc234a75085820fca0ca2a39e498274. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-07. Source cohort: artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:non-reasoning:effort=unspecified:suffix=Non-reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Non-reasoning) (release gemma-4-e4b, row gemma-4-e4b-non-reasoning, UUID 5303601c-8133-4f52-bc4e-5241ee6b3c10, reasoning=false, effort=not specified, suffix=Non-reasoning). This source capture does not provide an average reasoning-token count. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: non-reasoning. Reasoning effort: none
- Context
- The benchmark page describes 3,460 questions in the full MMMU-Pro dataset; AA's methodology specifies a 1,730-question run.
MMMU-Pro: Overall (Show measurement, test conditions, and source)
- Source value
- 51.38728323699419
- Score
- 51.38728323699419
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- AA cohort: 1,730 questions
- Category
- multimodal
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- superseded
- Retrieved at
- 2026-11-02
- Methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/d80eb0f1-f62e-4d31-99d2-7a925eb126b0/gemma-4-e4b/gemma-4-e4b. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled. Score display: 51.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-02-67d46be20a5b. Source payload hash: 67d46be20a5b412db6cfb60ad190441fcaa5513500b8fd47d033168d0e97b6b2. Parser version: artificial-analysis-rsc-models-v3. Imported at: 2026-11-02. Source cohort: artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:reasoning:effort=unspecified:suffix=Reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). AA source value for average reasoning tokens before the answer: 2000. Its methodology averages 60 varied prompts and assumes 2,000 when no average is available. This is not a token cap. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled
- Context
- The benchmark page describes 3,460 questions in the full MMMU-Pro dataset; AA's methodology specifies a 1,730-question run.. This result is retained as historical evidence and is not interchangeable with current results.
MMMU-Pro: Overall (Show measurement, test conditions, and source)
- Source value
- 51.38728323699419
- Score
- 51.38728323699419
- Metric
- pass@1 accuracy
- Unit
- %
- Benchmark version
- AA cohort: 1,730 questions
- Category
- multimodal
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Artificial Analysis
- Status
- active
- Retrieved at
- 2026-11-07
- Methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). This source capture does not provide an average reasoning-token count. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/d80eb0f1-f62e-4d31-99d2-7a925eb126b0/gemma-4-e4b/gemma-4-e4b. Source model name: Gemma 4 E4B IT. Provider reported by source: Google. Model snapshot: Gemma 4 E4B (Reasoning). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled. Score display: 51.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-11-07-b96e3ffc8c5b. Source payload hash: b96e3ffc8c5b052aa56f96d05e89d02b8cc234a75085820fca0ca2a39e498274. Parser version: artificial-analysis-rsc-models-v4. Imported at: 2026-11-07. Source cohort: artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:reasoning:effort=unspecified:suffix=Reasoning
- Comparison methodology
- Exact AA configuration: Gemma 4 E4B (Reasoning) (release gemma-4-e4b, row gemma-4-e4b, UUID d80eb0f1-f62e-4d31-99d2-7a925eb126b0, reasoning=true, effort=not specified, suffix=Reasoning). This source capture does not provide an average reasoning-token count. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled
- Context
- The benchmark page describes 3,460 questions in the full MMMU-Pro dataset; AA's methodology specifies a 1,730-question run.
MMLU Pro (Show measurement, test conditions, and source)
- Source value
- 69.4
- Score
- 69.4
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Google Gemma 4 official model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Gemma 4 E4B instruction-tuned column; card omits per-task prompts, decoding setup, and evaluation date.
AIME 2026 no tools (Show measurement, test conditions, and source)
- Source value
- 42.5
- Score
- 42.5
- Metric
- percent
- Unit
- %
- Benchmark version
- AIME 2026
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Google Gemma 4 official model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Gemma 4 E4B instruction-tuned; explicitly labeled no tools; additional prompt and decoding details are not stated.
Page 1 of 8
Popularity compared
How often the model is searched for, used and mentioned, compared with every model of its category.
Popularity index
The 100 most popular models of this category, 0 to 100, higher is more popular
20 of 101 models
As of November 2026 · Source: gradually.ai popularity index
Over time
Weekly values from October 18, 2026 to November 7, 2026
Gemma 4 E4B ITMiMo V2.6 Distill Qwen 9B 47Llama 3.1 8B Instruct 46Sage-A1.5 46Laguna XS.2 46
Method changes in the timeline, a jump at these points is no market event:
- 1November 1, 2026: Value only with search or usage data, 30-day attention
What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.
Similar models
More models of the same kind as Gemma 4 E4B IT, chosen by model line, developer, size, price and release date.
- Gemma 4 E2B ITGoogle · same developer
- Gemma 3n E4B ITGoogle · same developer
- Gemma 4 12B ITGoogle · same developer
- Gemma 3n E2B ITGoogle · same developer
- Gemma 4 26B A4BGoogle · same developer
- DiffusionGemma 26B A4B ITGoogle · same developer
- Gemma 4 31BGoogle · same developer
- Gemini 3.1 Pro PreviewGoogle · same developer
All specifications
Architecture
Input and output
Watermarking and provenance
AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.
- AI watermarking
- Unknown
- no source
- Watermarking technique
- Not known
- no source
Licence and access
Frequently asked questions about Gemma 4 E4B IT
How good is Gemma 4 E4B IT in benchmarks?
Independent results are not yet enough for the overall index. An estimate from 3 vendor-reported results (GPQA Diamond 58.6%, LiveCodeBench v6 52%, MMLU-Pro 69.4%) gives about 43.8 points, with a 95% range of 23.6 to 64.1. The estimate is calibrated on models with both vendor-reported and independent results. Vendor numbers run clearly above independent measurements on some tests; the calibration offsets that on average.
Vendor estimate, not an overall index value
How large is the context window of Gemma 4 E4B IT?
131,072 tokens. That is how much text Gemma 4 E4B IT reads at once, about 200 A4 pages.
Page count as a rule of thumb from Artificial Analysis
GLM-5.1200K
DeepSeek-V3 0324164K
Gemma 4 E4B ITRank 94 of 103131K
GLM-4.5131K
GPT OSS 120B131K
DeepSeek-V3.2128K
DeepSeek-R1128K
How fast is Gemma 4 E4B IT?
52 tokens per second. That is slower than a typical model at 87.
Measured by Artificial Analysis on Nov 6, 2026. AA 3.0.0, including time to first token, averaged across available workloads and five days.
GLM-5.3-Flash56
Qwen 3.7 Plus56
Claude Opus 4.652
Gemma 4 E4B ITRank 81 of 10152
GPT-6.1 Sol51
MiMo-V2.549
Qwen 3.8 Max 090246
Can I run Gemma 4 E4B IT locally?
Yes, the weights are open.
Stated by Google
- Open weights
- yes
- License
- Apache 2.0
- Parameters
- 8B
- active per token
- n/a
Sources and data date
Show all 37 sources
Benchmark sources at a glance
Which independent evaluators tested this model. This is coverage, not a quality ranking.
| Evaluator | Test series | Composite indices | Recorded active measurements |
|---|---|---|---|
| Artificial Analysis | 3 | 0 | 5 |
Without vendor claims and historical or disputed results; those stay labelled in the single values.
| Type | Evidence and data date |
|---|---|
| Speed | Median across serving providers, Reasoning enabled; effort unspecified. AA 3.0.0, including time to first token, averaged across available workloads and five days. Retrieved November 6, 2026. |
| Input | Documented modalities. Retrieved October 27, 2026. |
| Output | Documented modalities. Retrieved October 27, 2026. |
| Research status | Research date October 15, 2026. 25 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication. |
| Not published | benchmark-protocol-details Note The card does not specify per-task prompts, decoding settings, or evaluation dates. |
| Not published | immutable model revision Original wording The pinned evaluation config explicitly leaves each Hugging Face `revision` null; no immutable weights revision can be established from this source. |
| Not published | model-side reasoning or effort setting Original wording The paper identifies prompt strategy but does not publish a separate model-side thinking/effort toggle for these exact conditions. |
| Additional source | Hugging Face (retrieved October 15, 2026) · Gemma 4 E4B instruction-tuned weights · Editorial description reviewed October 2, 2026 |
| Additional source | Artificial Analysis (retrieved November 2, 2026) |
| Additional source | Artificial Analysis (retrieved October 29, 2026; November 2, 2026; November 7, 2026) |
| Additional source | Artificial Analysis (retrieved November 2, 2026; November 7, 2026)12 |
| Additional source | Gemma 4 model card (retrieved October 17, 2026) |
| Additional source | Gemma 4 Technical Report v2 (retrieved October 17, 2026; October 18, 2026; October 22, 2026) |
| Additional source | Unified Deployment-Aware Evaluation (UDAE), pinned public result CSV (retrieved October 17, 2026)12 |
| Additional source | Unified Deployment-Aware Evaluation (UDAE), TMLR v3, Table 16 (retrieved October 17, 2026) |
| Additional source | UDAE v3 full500 per-condition prompt-ablation summary (retrieved October 17, 2026) |
| Additional source | T1-Bench paper (arXiv:2606.11070v1) (retrieved October 17, 2026) |
| Additional source | Google DeepMind Gemma 4 family page (retrieved October 17, 2026) |
| Additional source | OpenBMB MiniCPM5-2B model card (retrieved October 18, 2026) |
| Additional source | LlamaIndex ExtractBench (retrieved October 20, 2026) |
| Additional source | Model metadata (retrieved October 17, 2026)1234567891011 |
| Additional source | Model metadata (retrieved October 20, 2026)12 |
| Additional source | OpenRouter: Popularity index (derived), CC BY 4.0 |
| Additional source | Vercel AI Gateway: Popularity index (derived), CC BY 4.0 |
| Additional source | Ollama: cumulative downloads for the popularity index |
| Additional source | Replicate: cumulative runs for the popularity index |
| Additional source | Google Trending Now: limited feed selection for Germany and the US |
| Additional source | Creative Commons Attribution 4.0 |