Gemini 3.5 Flash
Unavailable in this round
What was new in Gemini 3.5 Flash was its stable GA release in a line whose direct predecessor is Gemini 3 Flash Preview and which, according to the model card, underpins Gemini 3.6 Flash. The GA label separates it from the neighboring preview.
Google documents a 1,048,576-token context, 65,536 output tokens, and multimodal input. It discloses neither a parameter count nor a knowledge cutoff.
The index averages rank percentiles from 10 documented comparison cohorts.
Page 1 of 22
Reliability evaluation on 165 GAIA tasks with repetitions and perturbations. Accuracy, reliability, consistency, predictability, robustness, and safety are separate metrics.
| Sub-task | Gemini 3.5 Flash (This model) | Claude Opus 4.5 | Claude Opus 4.7 | Gemini 3.1 Pro Preview | GPT-4o mini | Gemini 2.5 Pro | Gemini 2.5 Flash | o1 | GPT-5.5 |
|---|---|---|---|---|---|---|---|---|---|
| Consistency | 0.75 | 0.81 (best value in this row) | 0.81 (best value in this row) | 0.76 | 0.73 | 0.72 | 0.7 | 0.68 | 0.61 |
| Predictability | 0.8 | 0.84 (best value in this row) | 0.73 | 0.78 | 0.58 | 0.71 | 0.64 | 0.68 | 0.8 |
| Reliability | 0.84 | 0.85 (best value in this row) | 0.84 | 0.82 | 0.76 | 0.78 | 0.74 | 0.79 | 0.79 |
| Robustness | 0.96 | 0.91 | 0.99 | 0.94 | 0.97 | 0.91 | 0.87 | 1 (best value in this row) | 0.95 |
| Safety | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) | 1 (best value in this row) |
Unit: ratinghigher is betterAs of August 6, 2026Source: Princeton HALbars scaled within each row, not across rows
Accuracy
Reliability evaluation on 165 GAIA tasks with repetitions and perturbations. Accuracy, reliability, consistency, predictability, robustness, and safety are separate metrics.
higher is betterAs of August 6, 2026Scale: 0% - 100%
26 cleaned customer-service tasks involving dialogue, policy compliance, and mutating backend tools. The cleaned subset removes 24 broken or ambiguous tasks. Accuracy and reliability dimensions measure different properties.
| Sub-task | Gemini 3.5 Flash (This model) | Claude Opus 4.7 | Claude Opus 4.5 | GPT-5.5 | Gemini 3.1 Pro Preview | Gemini 2.5 Flash | Gemini 2.5 Pro | GPT-4o mini | o1 |
|---|---|---|---|---|---|---|---|---|---|
| Consistency | 0.78 | 0.88 (best value in this row) | 0.84 | 0.84 | 0.81 | 0.75 | 0.74 | 0.74 | 0.71 |
| Predictability | 0.82 | 0.87 (best value in this row) | 0.85 | 0.84 | 0.83 | 0.6 | 0.78 | 0.35 | 0.74 |
| Reliability | 0.86 | 0.89 (best value in this row) | 0.88 | 0.89 (best value in this row) | 0.86 | 0.72 | 0.81 | 0.67 | 0.81 |
| Robustness | 0.97 | 0.91 | 0.97 | 0.97 | 0.94 | 0.82 | 0.93 | 0.93 | 0.98 (best value in this row) |
| Safety | 0.99 (best value in this row) | 0.94 | 0.98 | 0.96 | 0.97 | 0.9 | 0.92 | 0.85 | 0.91 |
Unit: ratinghigher is betterAs of August 5, 2026Source: Princeton HALbars scaled within each row, not across rows
Accuracy
26 cleaned customer-service tasks involving dialogue, policy compliance, and mutating backend tools. The cleaned subset removes 24 broken or ambiguous tasks. Accuracy and reliability dimensions measure different properties.
higher is betterAs of August 5, 2026Scale: 0% - 100%
Page 1 of 22
One SVG prompt and fixed output settings. Captures are shown only with 0 reported reasoning tokens or documented lack of reasoning controls. Identical test conditions do not make the models' internal compute identical.
Unavailable in this round
A community classic for free-form SVG drawing.
Gemini 3.5 Flash
The response reached the token limit. No complete recording is available.
Reasoning (requested): high
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)54.5 / 100
| Specification | Value and source |
|---|---|
| Weights | ProprietarySource |
| Access | APISource |
| Context window | 1,048,576 tokensSource |
| Notes | Released May 19, 2026. Google does not publish its parameter count, architecture, or knowledge cutoff.Source |
| API model ID | gemini-3.5-flashSource |
| Source status | stableSource |
| Maximum output | 65,536 tokensSource |
| Input | Text, Image, Video, Audio, pdfSource |
| Output | TextSource |
| Reasoning mode | low, medium, highSource |
| Tool calling | YesSource |
| Structured output | YesSource |
| Release | 2026-05-19Source |
| Capabilities | function calling, structured outputs, search grounding, Google Maps grounding, URL context, code execution, file search, computer useSource |
| General availability | 2026-05-19 (General availability (GA).)Source |
The model card's Model dependencies section states Gemini 3.5 Flash is based on the Gemini 3 Flash reasoning foundation, directing readers to the Gemini 3 Flash card for architecture, training data, hardware and software details.
Google DeepMind Gemini 3.5 Flash model card (2026-09-19)The model card's Model dependencies section states verbatim that Gemini 3.6 Flash is based on Gemini 3.5 Flash.
Google DeepMind Gemini 3.6 Flash model card (2026-09-19)