Language modelActive

Gemini 3.5 Flash-Lite

Google

Released: July 21, 2026
Data date: September 8, 2026
Predecessor: Gemini 3.1 Flash-Lite

Benchmark-Meta-Score: Unavailable
Minimum coverage not met
Speed: 338.3 tokens/s
Output throughput
Price: $0.3 · $2.5
Input · Output / 1M tokens
Input: Text, Image, Audio, Video
Output: Text

Gemini 3.5 Flash-Lite is the stable successor to Gemini 3.1 Flash-Lite. Google names document parsing and subagent tasks as focus areas.

Text, image, video, audio, and PDF inputs fit into a 1,048,576-token context. Computer use remains preview-only, and Google does not publish a parameter count.

Specifications and access

Specification	Value and source
Weights	ProprietarySource
Access	APISource
Context window	1,048,576 tokensSource
Notes	Announced July 21, 2026, high-throughput/low-latency Lite model for agentic search and document processing, Terminal-Bench 2.1 54%, SWE-Bench Pro 54.2%, OSWorld 74%Source
API model ID	gemini-3.5-flash-liteSource
Source status	stableSource
Maximum output	65,536 tokensSource
Input	Text, Image, Video, Audio, pdfSource
Output	TextSource
Reasoning mode	low, medium, highSource
Tool calling	YesSource
Structured output	YesSource
Release	2026-07-21Source
Capabilities	function calling, structured outputs, search grounding, Google Maps grounding, URL context, code execution, file searchSource

Benchmark meta-analysis

Overall and area scores

These Gradually indexes place selected published measurements on a 0 to 100 scale. They are not accuracy percentages and do not guarantee results in your application.

Retrieval dates of the sources used 2026-10-15 - 2026-10-19

Overall index

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 48 %
Test families: 34 / 71
Sources: 3
Mathematical bounds with missing values: 17.9-69.5 / 100

Coding

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 44 %
Test families: 8 / 15
Sources: 3
Mathematical bounds with missing values: 11.5-67.1 / 100

Reasoning

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 43 %
Test families: 4 / 7
Sources: 2
Mathematical bounds with missing values: 20.1-77.3 / 100

Knowledge

Index 58.3 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 67 %
Test families: 2 / 3
Sources: 2
Mathematical bounds with missing values: 38.9-72.2 / 100

Agents

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 25 %
Test families: 3 / 12
Sources: 1
Mathematical bounds with missing values: 10.9-85.9 / 100

General

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 20 %
Test families: 1 / 5
Sources: 1
Mathematical bounds with missing values: 4.4-84.4 / 100

Finance

Index 40.2 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 86 %
Test families: 6 / 7
Sources: 1
Mathematical bounds with missing values: 34.4-48.7 / 100

Legal

Index 31.3 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 75 %
Test families: 3 / 4
Sources: 1
Mathematical bounds with missing values: 23.4-48.4 / 100

Health

Index 32.7 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 67 %
Test families: 2 / 3
Sources: 1
Mathematical bounds with missing values: 21.8-55.2 / 100

Cybersecurity

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 100 %
Test families: 1 / 1
Sources: 1
Mathematical bounds with missing values: 27.3-27.3 / 100

Multimodal

Index 49.5 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 50 %
Test families: 2 / 4
Sources: 3
Mathematical bounds with missing values: 24.8-74.8 / 100

Productivity

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 50 %
Test families: 1 / 2
Sources: 1
Mathematical bounds with missing values: 3.9-53.9 / 100

Education

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 50 %
Test families: 1 / 2
Sources: 1
Mathematical bounds with missing values: 28.4-78.4 / 100

Documented method · Included test families and measurements

Method version: benchmark-meta-score-v1

The index includes active measurements from reviewed primary sources when at least five models are compared in the same documented comparison slice across dataset, harness, agent, tools, and trial count. Each benchmark series and evaluator contributes one shared setup slice from the newest capture; when dates match, the wider slice is used. When one source and series include several explicitly documented reasoning tiers, the highest documented tier (none through max) is selected, never the best result value. The explicit source label “Non-reasoning” is treated as none. When selecting between multiple results, unknown or ambiguous tiers exclude the model from that series. Unambiguous single configurations do not require a tier ordering. The best individual result for each model is not selected. Equal raw values share the same rank percentile. Multiple series from the same evaluator within a family receive equal weight; evaluators within a family, families within an area, and areas in the overall index then receive equal weight. Unmeasured series remain visible in coverage and bounds. An overall score requires at least four areas, six test families, and two sources. An area score requires at least two test families. Every overall and area score also requires at least 50% of its panel weight.

Published model-specific parameters can differ. This is not a controlled experiment; comparisons with such differences are marked provisional.

Unmeasured portions are not entered as zero. They reduce coverage and contribute only to the displayed bounds. Scores with different coverage are therefore not equally complete.

The bounds hold observed percentiles fixed and allow missing contributions anywhere from 0 to 100. They are not confidence intervals or predictions of future recalculations.

The source count is not a count of independent experiments.

OECD handbook on composite indicators

All 34 test families and 12 of 36 raw measurements are listed here. The complete calculation for every model is available in the JSON export.

Test family: AA-Briefcase
Agents · Family index: 32.9 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-briefcase
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  650.26 Elo
  Metric:
  AA-Briefcase Elo
  Version:
  v1.1
  Participating models:
  83
  Rank percentile within the cohort:
  32.9 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-briefcase:v1.1:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-briefcase","v1.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-LCR
Reasoning · Family index: 41.5 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-lcr
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.02 %
  Raw value:
  76 %
  Metric:
  Pass rate
  Version:
  v1.1
  Participating models:
  83
  Rank percentile within the cohort:
  41.5 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-lcr:v1.1:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-lcr","v1.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 76.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AutomationBench-AA
Agents · Family index: 56.1 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-automationbench-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  25.011270511840955 %
  Metric:
  Objectives completed without guardrail violations
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  56.1 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-automationbench-aa:unspecified:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-automationbench-aa","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 25.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GDP.pdf
Reasoning · Family index: 63.4 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-gdp-pdf
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.02 %
  Raw value:
  13.600000000000001 %
  Metric:
  All-pass rate
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  63.4 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-gdp-pdf:unspecified:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-gdp-pdf","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 13.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GDPval-AA
Agents · Family index: 41.5 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-gdpval-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  983.28 Elo
  Metric:
  GDPval-AA Elo
  Version:
  v2.1
  Participating models:
  83
  Rank percentile within the cohort:
  41.5 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-gdpval-aa:v2.1:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-gdpval-aa","v2.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-Omniscience
Knowledge · Family index: 64.6 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-omniscience
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  2.38 %
  Raw value:
  5.233333333333333 points
  Metric:
  AA-Omniscience Index
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  64.6 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-omniscience:unspecified:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-omniscience","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GPQA Diamond
Reasoning · Family index: 47.4 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 50 %
- Vals AI
  Published configurations differ within this cohort.
  Measurement:
  vals-gpqa
  Series weight within the test family:
  50 %
  Nominal contribution to the overall panel:
  0.51 %
  Raw value:
  83.838 %
  Metric:
  accuracy
  Version:
  1
  Participating models:
  77
  Rank percentile within the cohort:
  47.4 %
  Retrieved:
  2026-10-15
  Comparison cohort:
  vals-gpqa:1:overall
  Reasoning tier:
  high
  Documented comparison setup
  Publication cohort:
  vals-gpqa:1:overall
  Dataset type:
  public
  Setup and model parameters
  Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
  Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-01. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 13.848. Standard error: 1.847. Cost per task in USD: 0.01235. Source ID: vals-ai. Evidence capture ID: vals-gpqa-2026-10-15-951eb5224097. Source payload hash: 951eb5224097733a9d09d06c14908ae2980e2e640e539f2c284877c5092d7077. Parser version: vals-astro-v3. Imported at: 2026-10-15
Test family: Humanity’s Last Exam
Reasoning · Family index: 24.4 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 50 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-humanitys-last-exam
  Series weight within the test family:
  50 %
  Nominal contribution to the overall panel:
  0.51 %
  Raw value:
  18.813716404077798 %
  Metric:
  Text-only pass@1 accuracy
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  24.4 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-humanitys-last-exam:unspecified:v4.3.2:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-humanitys-last-exam","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Score display: 18.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: LMArena Code Arena WebDev
Coding · Family index: 19.4 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
- LMArena
  Published configurations differ within this cohort.
  Measurement:
  lmarena-code-webdev
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.48 %
  Raw value:
  1,440.4005622297457 rating
  Metric:
  WebDev Arena Bradley-Terry rating
  Version:
  webdev
  Participating models:
  37
  Rank percentile within the cohort:
  19.4 %
  Retrieved:
  2026-10-15
  Comparison cohort:
  lmarena-code-webdev:2026-10-13:overall
  Documented comparison setup
  Publication cohort:
  lmarena-code-webdev:2026-10-13:overall
  Dataset type:
  public-crowdsourced-preferences
  Harness:
  Arena Code Arena WebDev
  Setup and model parameters
  Arena rating from 242 published pairwise votes.. Harness: Arena Code Arena WebDev
  Arena rating from 242 published pairwise votes.. Source model ID: lmarena/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: gemini-3.5-flash-lite. Evaluator: LMArena. Dataset type: public-crowdsourced-preferences. Leaderboard date: 2026-10-13. Harness: Arena Code Arena WebDev. Source ID: lmarena. Evidence capture ID: lmarena-webdev-4589dee83b594891961ae5190c508a9288d2c2ae-28f8076e6c27. Source payload hash: 28f8076e6c27f1f89239f3d7243456357dfa175b078646a6bd859935b162cc9c. Parser version: lmarena-dataset-v1. Imported at: 2026-10-15
Test family: LMArena Text, Style Control
General · Family index: 22.2 / 100
Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
- LMArena
  Published configurations differ within this cohort.
  Measurement:
  lmarena-text-style-control
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.43 %
  Raw value:
  1,454.971388095603 rating
  Metric:
  style-controlled Bradley-Terry rating
  Version:
  style-control-v1
  Participating models:
  37
  Rank percentile within the cohort:
  22.2 %
  Retrieved:
  2026-10-15
  Comparison cohort:
  lmarena-text-style-control:2026-10-13:overall
  Documented comparison setup
  Publication cohort:
  lmarena-text-style-control:2026-10-13:overall
  Dataset type:
  public-crowdsourced-preferences
  Harness:
  Arena Text, style control
  Setup and model parameters
  Arena rating from 35,845 published pairwise votes.. Harness: Arena Text, style control
  Arena rating from 35,845 published pairwise votes.. Source model ID: lmarena/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: gemini-3.5-flash-lite. Evaluator: LMArena. Dataset type: public-crowdsourced-preferences. Leaderboard date: 2026-10-13. Harness: Arena Text, style control. Source ID: lmarena. Evidence capture ID: lmarena-4589dee83b594891961ae5190c508a9288d2c2ae-a39cbed99996. Source payload hash: a39cbed99996f4993a4cd66d8322b2edb939f1ffdbd377c9d3769edd01dd78ca. Parser version: lmarena-dataset-v1. Imported at: 2026-10-15
Test family: LMArena Vision, Style Control
Multimodal · Family index: 40.0 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
- LMArena
  Published configurations differ within this cohort.
  Measurement:
  lmarena-vision-style-control
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.79 %
  Raw value:
  1,265.9991699575933 rating
  Metric:
  style-controlled Bradley-Terry rating
  Version:
  style-control-v1
  Participating models:
  31
  Rank percentile within the cohort:
  40.0 %
  Retrieved:
  2026-10-15
  Comparison cohort:
  lmarena-vision-style-control:2026-10-09:overall
  Documented comparison setup
  Publication cohort:
  lmarena-vision-style-control:2026-10-09:overall
  Dataset type:
  public-crowdsourced-preferences
  Harness:
  Arena Vision, style control
  Setup and model parameters
  Arena rating from 8,381 published pairwise votes.. Harness: Arena Vision, style control
  Arena rating from 8,381 published pairwise votes.. Source model ID: lmarena/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: gemini-3.5-flash-lite. Evaluator: LMArena. Dataset type: public-crowdsourced-preferences. Leaderboard date: 2026-10-09. Harness: Arena Vision, style control. Source ID: lmarena. Evidence capture ID: lmarena-vision_style_control-4589dee83b594891961ae5190c508a9288d2c2ae-6cf1fae8efc9. Source payload hash: 6cf1fae8efc9ef6fe066f27d5bbe558cd360803a9c0fa6d89905aa53934efdb4. Parser version: lmarena-dataset-v1. Imported at: 2026-10-15
Test family: MMMU-Pro
Multimodal · Family index: 59.1 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-mmmu-pro
  Series weight within the test family:
  50 %
  Nominal contribution to the overall panel:
  0.89 %
  Raw value:
  79.0173410404624 %
  Metric:
  pass@1 accuracy
  Version:
  AA cohort: 1,730 questions
  Participating models:
  57
  Rank percentile within the cohort:
  66.1 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-mmmu-pro:AA cohort: 1,730 questions:standalone:reasoning:tokens=0:suffix=unspecified
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-mmmu-pro","AA cohort: 1,730 questions","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Tool policy:
  Ten-option multiple choice; regex answer extraction
  Attempts:
  pass@1, one run per question
  Setup and model parameters
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled
  Exact AA configuration: Gemini 3.5 Flash-Lite (release gemini-3-5-flash-lite, row gemini-3-5-flash-lite, UUID 093b9df2-ebee-4309-943f-5a7e88360adf, reasoning=true, source reasoning-token configuration budget=0, suffix=not specified). This configured value is not measured token consumption. The AA run covers 1,730 questions with ten answer options. Answers are extracted by regex and scored pass@1.. Source model ID: artificial-analysis/093b9df2-ebee-4309-943f-5a7e88360adf/gemini-3-5-flash-lite/gemini-3-5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Model snapshot: Gemini 3.5 Flash-Lite. Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Ten-option multiple choice; regex answer extraction. Attempts: pass@1, one run per question. Reasoning: reasoning enabled. Score display: 79.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: SWE-bench Verified
Coding · Family index: 45.8 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: Terminal-Bench
Coding · Family index: 42.0 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 67 %
Test family: Terminal-Bench Science
Coding · Family index: 4.3 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: Code Migration
Coding · Family index: 11.3 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: CorpFin v2
Finance · Family index: 39.2 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: CyberBench v1.1
Cybersecurity · Family index: 27.3 / 100
Nominal family weight in the overall panel: 7.14 % · Coverage of this test family: 100 %
Test family: EMB
Finance · Family index: 22.0 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Finance Agent (v2)
Finance · Family index: 36.7 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: LiveCodeBench v6
Coding · Family index: 28.6 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Harvey's Legal Agent Benchmark
Legal · Family index: 10.7 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: LegalBench
Legal · Family index: 67.3 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: Legal Research Bench
Legal · Family index: 15.8 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: MedCode
Health · Family index: 52.2 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MedScribe
Health · Family index: 13.2 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MMLU-Pro
Knowledge · Family index: 51.9 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MortgageTax
Finance · Family index: 79.8 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: ProgramBench
Coding · Family index: 24.5 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: SAGE
Education · Family index: 56.9 / 100
Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: Public Benefits Bench v1.1
Productivity · Family index: 7.9 / 100
Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: Tax Agent Bench
Finance · Family index: 14.5 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: TaxEval v2
Finance · Family index: 48.7 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Vibe Code Bench v1.1
Coding · Family index: 36.1 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %

Benchmark sources at a glance

Each evaluator measures different capabilities under its own conditions. Test series, composite indices and their components stay separate. The detailed results below retain their scales, configurations and source dates.

Evaluator	Test series	Composite indices	Recorded active measurements
Artificial Analysis	10	1	13
Vals AI	23	1	174
LMArena	3	0	41

Coverage is not a quality ranking. Overlapping tests and multiple settings do not count as independent experiments. Vendor claims, historical and disputed results are excluded from this overview and remain labelled in the detailed evidence.

Published benchmarks

Coding

Code Migration

Sub-task	Gemini 3.5 Flash-Lite (This model)	Gemini 3.8 Flash	Gemini 3.7 Flash	Gemini 3.6 Flash	Gemini 3.5 Flash	Gemini 3.1 Pro Preview	Gemini 3 Flash Preview	Gemini 3.1 Flash-Lite
CLI	5.88%	25.87% (best value in this row)	23.54%	19.33%	17.18%	10.83%	8.52%	5.73%
COBOL	6.96%	68.57% (best value in this row)	68.57% (best value in this row)	65.71%	55.46%	36.75%	0%	1.25%
Overall	6.15%	36.55% (best value in this row)	34.8%	30.93%	26.75%	17.31%	6.39%	4.61%

higher is betterAs of October 15, 2026Source: Vals AIbars scaled within each row, not across rows

Methodology and context

Metric: accuracy

Code Migration

Code Quality

1.Gemini 3.8 Flash3.74 rating

2.Gemini 3.7 Flash3.66 rating

3.Gemini 3.6 Flash3.3 rating

4.Gemini 3.5 Flash2.79 rating

5.Gemini 3.1 Flash-Lite2.66 rating

6.Gemini 3 Flash Preview2.66 rating

7.Gemini 3.5 Flash-Lite2.65 rating

8.Gemini 3.1 Pro Preview2.54 rating

higher is betterAs of October 15, 2026Scale: 0 rating - 3.74 rating

Source: Vals AI

|

gradually.ai

Methodology and context

Comparison cohort: vals-code-migration:1:code_quality
Metric: mean reviewer code-quality rating
Scale: No upper bound is documented. The chart spans the recorded values and zero.
Participants: 8
Methodology and context: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1322.302. Standard error: 0.05. Cost per task in USD: 0.525186. Score display: 2.652 / 5. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15

Source: Vals AI

Finance

CorpFin v2

Sub-task	Gemini 3.5 Flash-Lite (This model)	Gemini 3 Flash Preview	Gemini 3.5 Flash	Gemini 3.6 Flash	Gemini 3.1 Pro Preview	Gemini 3.1 Flash-Lite
Exact Pages	57.46%	68.07% (best value in this row)	62.82%	61.07%	60.84%	56.64%
Max Fitting Context	62.35%	63.52%	66.67%	65.39%	66.9% (best value in this row)	60.61%
Overall	60.68%	66.43% (best value in this row)	64.69%	63.33%	64.49%	59.36%
Shared Max Context	62.24%	67.72% (best value in this row)	64.57%	63.52%	65.73%	60.84%

higher is betterAs of October 15, 2026Source: Vals AIbars scaled within each row, not across rows

Methodology and context

Metric: accuracy

Cybersecurity

CyberBench v1.1

Sub-task	Gemini 3.5 Flash-Lite (This model)	Gemini 3.6 Flash	Gemini 3.7 Flash	Gemini 3.8 Flash
Overall	59.11% (best value in this row)	45.36%	43.75%	43.75%
Patch	73.21%	85.71%	87.5% (best value in this row)	87.5% (best value in this row)
PoC	45% (best value in this row)	5%	0%	0%

higher is betterAs of October 15, 2026Source: Vals AIbars scaled within each row, not across rows

Methodology and context

Metric: accuracy

Recorded measurement details

Code Migration: CLI (Show measurement, test conditions, and source)

Source value: 5.875
Score: 5.875
Metric: accuracy
Unit: %
Benchmark version: 1
Category: coding
Task: cli
Task label: CLI
Direction: Higher is better
Comparison cohort: vals-code-migration:1:cli
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1185.207. Standard error: 1.25. Cost per task in USD: 0.478513. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

Code Migration: COBOL (Show measurement, test conditions, and source)

Source value: 6.964
Score: 6.964
Metric: accuracy
Unit: %
Benchmark version: 1
Category: coding
Task: cobol
Task label: COBOL
Direction: Higher is better
Comparison cohort: vals-code-migration:1:cobol
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1733.588. Standard error: 5.712. Cost per task in USD: 0.665203. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

Code Migration: Overall (Show measurement, test conditions, and source)

Source value: 6.148
Score: 6.148
Metric: accuracy
Unit: %
Benchmark version: 1
Category: coding
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-code-migration:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1322.302. Standard error: 1.708. Cost per task in USD: 0.525186. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

Code Migration: Code Quality (Show measurement, test conditions, and source)

Source value: 2.652
Score: 2.652
Metric: mean reviewer code-quality rating
Unit: rating
Benchmark version: 1
Category: coding
Task: code_quality
Task label: Code Quality
Direction: Higher is better
Comparison cohort: vals-code-migration:1:code_quality
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1322.302. Standard error: 0.05. Cost per task in USD: 0.525186. Score display: 2.652 / 5. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CorpFin v2: Exact Pages (Show measurement, test conditions, and source)

Source value: 57.459
Score: 57.459
Metric: accuracy
Unit: %
Benchmark version: 2
Category: finance
Task: exact_pages
Task label: Exact Pages
Direction: Higher is better
Comparison cohort: vals-corp-fin-v2:2:exact_pages
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 2.557. Standard error: 1.688. Cost per task in USD: 0.002608. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CorpFin v2: Max Fitting Context (Show measurement, test conditions, and source)

Source value: 62.354
Score: 62.354
Metric: accuracy
Unit: %
Benchmark version: 2
Category: finance
Task: max_fitting_context
Task label: Max Fitting Context
Direction: Higher is better
Comparison cohort: vals-corp-fin-v2:2:max_fitting_context
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 4.541. Standard error: 1.654. Cost per task in USD: 0.059711. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CorpFin v2: Overall (Show measurement, test conditions, and source)

Source value: 60.684
Score: 60.684
Metric: accuracy
Unit: %
Benchmark version: 2
Category: finance
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-corp-fin-v2:2:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 3.836. Standard error: 0.962. Cost per task in USD: 0.028548. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CorpFin v2: Shared Max Context (Show measurement, test conditions, and source)

Source value: 62.238
Score: 62.238
Metric: accuracy
Unit: %
Benchmark version: 2
Category: finance
Task: shared_max_context
Task label: Shared Max Context
Direction: Higher is better
Comparison cohort: vals-corp-fin-v2:2:shared_max_context
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 4.411. Standard error: 1.655. Cost per task in USD: 0.023324. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CyberBench v1.1: Overall (Show measurement, test conditions, and source)

Source value: 59.107
Score: 59.107
Metric: accuracy
Unit: %
Benchmark version: 1.1
Category: cybersecurity
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-cyberbench:1.1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1075.887. Standard error: 6.17. Cost per task in USD: 0.425124. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-10-15-943f593f929f. Source payload hash: 943f593f929f8971a6b746269a2851b5febc2aad4e2f1066895f715033cdc7f1. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CyberBench v1.1: Patch (Show measurement, test conditions, and source)

Source value: 73.214
Score: 73.214
Metric: accuracy
Unit: %
Benchmark version: 1.1
Category: cybersecurity
Task: patch
Task label: Patch
Direction: Higher is better
Comparison cohort: vals-cyberbench:1.1:patch
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 698.939. Standard error: 5.918. Cost per task in USD: 0.363507. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-10-15-943f593f929f. Source payload hash: 943f593f929f8971a6b746269a2851b5febc2aad4e2f1066895f715033cdc7f1. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

CyberBench v1.1: PoC (Show measurement, test conditions, and source)

Source value: 45
Score: 45
Metric: accuracy
Unit: %
Benchmark version: 1.1
Category: cybersecurity
Task: poc
Task label: PoC
Direction: Higher is better
Comparison cohort: vals-cyberbench:1.1:poc
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: google/gemini-3.5-flash-lite. Source model name: Gemini 3.5 Flash-Lite. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1452.835. Standard error: 6.423. Cost per task in USD: 0.486741. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-10-15-943f593f929f. Source payload hash: 943f593f929f8971a6b746269a2851b5febc2aad4e2f1066895f715033cdc7f1. Parser version: vals-astro-v3. Imported at: 2026-10-15
Comparison methodology: Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536

Page 1 of 19

Predecessor and successor

Sources and data date

Type	Evidence and data date
Speed	Google. Output speed after the first streaming chunk, not total response time. Retrieved September 7, 2026. Source: Artificial Analysis · Speed (Artificial Analysis)Speed measurement methodology
Price	Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs. Source: Pricing · API pricing
Input	Documented modalities. Retrieved September 7, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Gemini 3.5 Flash-Lite API documentation · Editorial description reviewed October 2, 2026
Output	Documented modalities. Retrieved September 7, 2026. Source: Model documentation · Model metadata (retrieved September 8, 2026) · Gemini 3.5 Flash-Lite API documentation · Editorial description reviewed October 2, 2026
Research status	Research date September 8, 2026. 3 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not found in the inspected sources	parameters-billions Original wording Google does not publish a parameter count on the Gemini API model page.
Not found in the inspected sources	active-parameters-billions Original wording Google does not publish active parameter counts for Gemini API models.
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	LMArena (retrieved October 15, 2026)
Additional source	LMArena (retrieved October 15, 2026)
Additional source	LMArena (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved August 11, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Google DeepMind (retrieved September 8, 2026) · Gemini 3.5 Flash-Lite model card · Editorial description reviewed October 2, 2026
Additional source	Model metadata (retrieved September 8, 2026)
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Ollama: cumulative downloads for the popularity index
Additional source	Replicate: cumulative runs for the popularity index
Additional source	Google Trending Now: limited feed selection for Germany and the US
Additional source	Creative Commons Attribution 4.0