Gemini 3.6 Flash
Unavailable in this round
Language modelActive
Gemini 3.6 Flash
- Released
- July 21, 2026
- Data date
- September 8, 2026
- Predecessor
- Gemini 3.5 Flash
- Successor
- Gemini 3.7 Flash
- Benchmark-Meta-Score
- Provisional, 57 % panel coverage
- Speed
- 218 tokens/sOutput throughput
- Price
- Input · Output / 1M tokens
- Input
- Text, Image, Audio, Video
- Output
- Text
Google names code generation and spatial reasoning as focus areas for Gemini 3.6 Flash. Its model card lists Gemini 3.5 Flash as the foundation and Gemini 3.7 Flash as the next direct step.
The API documents 1,048,576 context and 65,536 output tokens with multimodal input. Computer use remains preview; Google does not publish the parameter count, architecture, or a technical distinction between low, medium, and high reasoning.
- Position
- Rank 15 of 24
- Index score
- 43.1 / 100
Methodology and source
The LLM comparison hub's selected-panel index averages rank percentiles from 10 documented comparison cohorts. Benchmark meta-scores are shown in the benchmark section.
Benchmark meta-analysis
Overall and area scores
These Gradually indexes place selected published measurements on a 0 to 100 scale. They are not accuracy percentages and do not guarantee results in your application.
Retrieval dates of the sources used 2026-10-15 - 2026-10-19
Overall index
Index 52.5 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 57 %
- Test families
- 40 / 71
- Sources
- 4
- Mathematical bounds with missing values
- 29.9-73.0 / 100
Coding
Index 46.9 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 51 %
- Test families
- 9 / 15
- Sources
- 3
- Mathematical bounds with missing values
- 24.0-72.9 / 100
Reasoning
Index 64.3 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 64 %
- Test families
- 5 / 7
- Sources
- 3
- Mathematical bounds with missing values
- 41.3-77.0 / 100
Mathematics
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 40 %
- Test families
- 2 / 5
- Sources
- 1
- Mathematical bounds with missing values
- 9.2-69.2 / 100
Knowledge
Index 79.0 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 100 %
- Test families
- 3 / 3
- Sources
- 3
- Mathematical bounds with missing values
- 79.0-79.0 / 100
Agents
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 25 %
- Test families
- 3 / 12
- Sources
- 1
- Mathematical bounds with missing values
- 15.7-90.7 / 100
General
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 40 %
- Test families
- 2 / 5
- Sources
- 2
- Mathematical bounds with missing values
- 13.3-73.3 / 100
Finance
Index 64.2 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 86 %
- Test families
- 6 / 7
- Sources
- 1
- Mathematical bounds with missing values
- 55.0-69.3 / 100
Legal
Index 58.1 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 75 %
- Test families
- 3 / 4
- Sources
- 1
- Mathematical bounds with missing values
- 43.6-68.6 / 100
Health
Index 62.4 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 67 %
- Test families
- 2 / 3
- Sources
- 1
- Mathematical bounds with missing values
- 41.6-74.9 / 100
Cybersecurity
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 100 %
- Test families
- 1 / 1
- Sources
- 1
- Mathematical bounds with missing values
- 18.2-18.2 / 100
Multimodal
Index 75.4 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 2 / 4
- Sources
- 3
- Mathematical bounds with missing values
- 37.7-87.7 / 100
Productivity
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 1 / 2
- Sources
- 1
- Mathematical bounds with missing values
- 7.9-57.9 / 100
Education
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 1 / 2
- Sources
- 1
- Mathematical bounds with missing values
- 32.8-82.8 / 100
Documented method · Included test families and measurements
Method version: benchmark-meta-score-v1
The index includes active measurements from reviewed primary sources when at least five models are compared in the same documented comparison slice across dataset, harness, agent, tools, and trial count. Each benchmark series and evaluator contributes one shared setup slice from the newest capture; when dates match, the wider slice is used. When one source and series include several explicitly documented reasoning tiers, the highest documented tier (none through max) is selected, never the best result value. The explicit source label “Non-reasoning” is treated as none. When selecting between multiple results, unknown or ambiguous tiers exclude the model from that series. Unambiguous single configurations do not require a tier ordering. The best individual result for each model is not selected. Equal raw values share the same rank percentile. Multiple series from the same evaluator within a family receive equal weight; evaluators within a family, families within an area, and areas in the overall index then receive equal weight. Unmeasured series remain visible in coverage and bounds. An overall score requires at least four areas, six test families, and two sources. An area score requires at least two test families. Every overall and area score also requires at least 50% of its panel weight.
Published model-specific parameters can differ. This is not a controlled experiment; comparisons with such differences are marked provisional.
Unmeasured portions are not entered as zero. They reduce coverage and contribute only to the displayed bounds. Scores with different coverage are therefore not equally complete.
The bounds hold observed percentiles fixed and allow missing contributions anywhere from 0 to 100. They are not confidence intervals or predictions of future recalculations.
The source count is not a count of independent experiments.
OECD handbook on composite indicatorsAll 40 test families and 12 of 44 raw measurements are listed here. The complete calculation for every model is available in the JSON export.
Test family: AIME
Mathematics · Family index: 27.3 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
Published configurations differ within this cohort.
- Measurement:
- epoch-otis-mock-aime-2024-2025
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.43 %
- Raw value:
- 0.9416666666666667 ratio
- Metric:
- model_extracted_exact_match
- Version:
- 1.1.6
- Participating models:
- 23
- Rank percentile within the cohort:
- 27.3 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- epoch-score-design-v1:["OTIS Mock AIME 2024-2025","OTIS Mock AIME 2024-2025","1.1.6","model_extracted_exact_match"]
- Reasoning tier:
- high
- Documented comparison setup
- Publication cohort:
- epoch-score-design-v1:["OTIS Mock AIME 2024-2025","OTIS Mock AIME 2024-2025","1.1.6","model_extracted_exact_match"]
- Dataset type:
- not-reported-in-captured-run-csv
- Setup and model parameters
- Published reasoning tier: high. The capture does not report other inference parameters or a compute budget.
Independent evaluation. Epoch run alias: gemini-3.6-flash_high; Epoch model label: Gemini 3.6 Flash; Display label field: Gemini 3.6 Flash; Reasoning setting encoded in the alias: high. Task ID: OTIS Mock AIME 2024-2025. Task version: 1.1.6. Run ID: ajQFZGMjvyMTH2ULDZhwtz. Started at 2026-08-02T00:21:27.000Z. Original task label: OTIS Mock AIME 2024-2025. The published row reports mean_score=0.9416666666666667 and stderr=0.030926354359015452. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: high.
- Epoch AI benchmark run dataset snapshot
Test family: AA-Briefcase
Agents · Family index: 57.3 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-aa-briefcase
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 953.92 Elo
- Metric:
- AA-Briefcase Elo
- Version:
- v1.1
- Participating models:
- 83
- Rank percentile within the cohort:
- 57.3 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-aa-briefcase:v1.1:v4.3.2:reasoning:tokens=0:suffix=High
- Reasoning tier:
- High
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-aa-briefcase","v1.1","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: High
Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Source model ID: artificial-analysis/78332c88-fe60-42c8-af9d-3617e44cf1f5/gemini-3-6-flash/gemini-3-6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Model snapshot: Gemini 3.6 Flash (High). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: High. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: AA-LCR
Reasoning · Family index: 65.9 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-aa-lcr
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.02 %
- Raw value:
- 80 %
- Metric:
- Pass rate
- Version:
- v1.1
- Participating models:
- 83
- Rank percentile within the cohort:
- 65.9 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-aa-lcr:v1.1:v4.3.2:reasoning:tokens=0:suffix=High
- Reasoning tier:
- High
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-aa-lcr","v1.1","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: High
Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Source model ID: artificial-analysis/78332c88-fe60-42c8-af9d-3617e44cf1f5/gemini-3-6-flash/gemini-3-6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Model snapshot: Gemini 3.6 Flash (High). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: High. Score display: 80.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: AutomationBench-AA
Agents · Family index: 69.5 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-automationbench-aa
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 53.01669491509355 %
- Metric:
- Objectives completed without guardrail violations
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 69.5 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-automationbench-aa:unspecified:v4.3.2:reasoning:tokens=0:suffix=High
- Reasoning tier:
- High
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-automationbench-aa","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: High
Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Source model ID: artificial-analysis/78332c88-fe60-42c8-af9d-3617e44cf1f5/gemini-3-6-flash/gemini-3-6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Model snapshot: Gemini 3.6 Flash (High). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: High. Score display: 53.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: GDP.pdf
Reasoning · Family index: 70.7 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-gdp-pdf
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.02 %
- Raw value:
- 17.4 %
- Metric:
- All-pass rate
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 70.7 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-gdp-pdf:unspecified:v4.3.2:reasoning:tokens=0:suffix=High
- Reasoning tier:
- High
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-gdp-pdf","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: High
Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Source model ID: artificial-analysis/78332c88-fe60-42c8-af9d-3617e44cf1f5/gemini-3-6-flash/gemini-3-6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Model snapshot: Gemini 3.6 Flash (High). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: High. Score display: 17.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: GDPval-AA
Agents · Family index: 61.0 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-gdpval-aa
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 1,284.34 Elo
- Metric:
- GDPval-AA Elo
- Version:
- v2.1
- Participating models:
- 83
- Rank percentile within the cohort:
- 61.0 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-gdpval-aa:v2.1:v4.3.2:reasoning:tokens=0:suffix=High
- Reasoning tier:
- High
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-gdpval-aa","v2.1","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: High
Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Source model ID: artificial-analysis/78332c88-fe60-42c8-af9d-3617e44cf1f5/gemini-3-6-flash/gemini-3-6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Model snapshot: Gemini 3.6 Flash (High). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: High. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: AA-Omniscience
Knowledge · Family index: 81.7 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-omniscience
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 2.38 %
- Raw value:
- 22.133333333333333 points
- Metric:
- AA-Omniscience Index
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 81.7 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-omniscience:unspecified:v4.3.2:reasoning:tokens=0:suffix=High
- Reasoning tier:
- High
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-omniscience","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: High
Exact AA configuration: Gemini 3.6 Flash (High) (release gemini-3-6-flash, row gemini-3-6-flash, UUID 78332c88-fe60-42c8-af9d-3617e44cf1f5, reasoning=true, source reasoning-token configuration budget=0, suffix=High). This configured value is not measured token consumption.. Source model ID: artificial-analysis/78332c88-fe60-42c8-af9d-3617e44cf1f5/gemini-3-6-flash/gemini-3-6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Model snapshot: Gemini 3.6 Flash (High). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: High. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: Chess Puzzles
Reasoning · Family index: 38.1 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
Published configurations differ within this cohort.
- Measurement:
- epoch-chess-puzzles
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.02 %
- Raw value:
- 0.4 ratio
- Metric:
- exact
- Version:
- 2.0.0
- Participating models:
- 22
- Rank percentile within the cohort:
- 38.1 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- epoch-score-design-v1:["Chess Puzzles","Chess Puzzles","2.0.0","exact"]
- Reasoning tier:
- high
- Documented comparison setup
- Publication cohort:
- epoch-score-design-v1:["Chess Puzzles","Chess Puzzles","2.0.0","exact"]
- Dataset type:
- not-reported-in-captured-run-csv
- Setup and model parameters
- Published reasoning tier: high. The capture does not report other inference parameters or a compute budget.
Independent evaluation. Epoch run alias: gemini-3.6-flash_high; Epoch model label: Gemini 3.6 Flash; Display label field: Gemini 3.6 Flash; Reasoning setting encoded in the alias: high. Task ID: Chess Puzzles. Task version: 2.0.0. Run ID: ZDeGG5QYkdgVqzGPmmnbfx. Started at 2026-10-13T13:14:52.000Z. Original task label: Chess Puzzles. The published row reports mean_score=0.4 and stderr=0.0492365963917331. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: high.
- Epoch AI benchmark run dataset snapshot
Test family: SimpleQA Verified
Knowledge · Family index: 69.4 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
Published configurations differ within this cohort.
- Measurement:
- epoch-simpleqa-verified
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 2.38 %
- Raw value:
- 0.662 ratio
- Metric:
- simpleqa_scorer
- Version:
- 1.2.0
- Participating models:
- 19
- Rank percentile within the cohort:
- 69.4 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- epoch-score-design-v1:["SimpleQA Verified","SimpleQA Verified (anti-abstention)","1.2.0","simpleqa_scorer"]
- Reasoning tier:
- high
- Documented comparison setup
- Publication cohort:
- epoch-score-design-v1:["SimpleQA Verified","SimpleQA Verified (anti-abstention)","1.2.0","simpleqa_scorer"]
- Dataset type:
- not-reported-in-captured-run-csv
- Setup and model parameters
- Published reasoning tier: high. The capture does not report other inference parameters or a compute budget.
Independent evaluation. Epoch run alias: gemini-3.6-flash_high; Epoch model label: Gemini 3.6 Flash; Display label field: Gemini 3.6 Flash; Reasoning setting encoded in the alias: high. Task ID: SimpleQA Verified. Task version: 1.2.0. Run ID: F83pa7Gfsb4UNVttTnS5Hk. Started at 2026-08-27T19:30:09.000Z. Original task label: SimpleQA Verified (anti-abstention). The published row reports mean_score=0.662 and stderr=0.014965960710224383. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: high.
- Epoch AI benchmark run dataset snapshot
Test family: FrontierMath
Mathematics · Family index: 18.8 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
Published configurations differ within this cohort.
- Measurement:
- epoch-frontiermath-tier-4-v2-private
- Series weight within the test family:
- 50 %
- Nominal contribution to the overall panel:
- 0.71 %
- Raw value:
- 0.21951219512195122 ratio
- Metric:
- verification_code
- Version:
- 2.0.0
- Participating models:
- 19
- Rank percentile within the cohort:
- 19.4 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- epoch-score-design-v1:["FrontierMath-Tier-4-v2-Private","FrontierMath-Tier-4-v2-Private","2.0.0","verification_code"]
- Reasoning tier:
- high
- Documented comparison setup
- Publication cohort:
- epoch-score-design-v1:["FrontierMath-Tier-4-v2-Private","FrontierMath-Tier-4-v2-Private","2.0.0","verification_code"]
- Dataset type:
- not-reported-in-captured-run-csv
- Setup and model parameters
- Published reasoning tier: high. The capture does not report other inference parameters or a compute budget.
Independent evaluation. Epoch run alias: gemini-3.6-flash_high; Epoch model label: Gemini 3.6 Flash; Display label field: Gemini 3.6 Flash; Reasoning setting encoded in the alias: high. Task ID: FrontierMath-Tier-4-v2-Private. Task version: 2.0.0. Run ID: JCMjXU6FRiiLV3xvs9R2Xv. Started at 2026-08-02T00:36:45.000Z. Original task label: FrontierMath-Tier-4-v2-Private. The published row reports mean_score=0.21951219512195122 and stderr=0.06544589202438408. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: high. - Epoch AI benchmark run dataset snapshot
Published configurations differ within this cohort.
- Measurement:
- epoch-frontiermath-tiers-1-3-v2-private
- Series weight within the test family:
- 50 %
- Nominal contribution to the overall panel:
- 0.71 %
- Raw value:
- 0.5894736842105263 ratio
- Metric:
- verification_code
- Version:
- 2.0.0
- Participating models:
- 23
- Rank percentile within the cohort:
- 18.2 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- epoch-score-design-v1:["FrontierMath-Tiers-1-3-v2-Private","FrontierMath-Tiers-1-3-v2-Private","2.0.0","verification_code"]
- Reasoning tier:
- high
- Documented comparison setup
- Publication cohort:
- epoch-score-design-v1:["FrontierMath-Tiers-1-3-v2-Private","FrontierMath-Tiers-1-3-v2-Private","2.0.0","verification_code"]
- Dataset type:
- not-reported-in-captured-run-csv
- Setup and model parameters
- Published reasoning tier: high. The capture does not report other inference parameters or a compute budget.
Independent evaluation. Epoch run alias: gemini-3.6-flash_high; Epoch model label: Gemini 3.6 Flash; Display label field: Gemini 3.6 Flash; Reasoning setting encoded in the alias: high. Task ID: FrontierMath-Tiers-1-3-v2-Private. Task version: 2.0.0. Run ID: nb9LnDeeQyvRCqsbsTANGD. Started at 2026-08-02T00:36:45.000Z. Original task label: FrontierMath-Tiers-1-3-v2-Private. The published row reports mean_score=0.5894736842105263 and stderr=0.02919063494391404. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: high.
- Epoch AI benchmark run dataset snapshot
Test family: GPQA Diamond
Reasoning · Family index: 81.1 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
Published configurations differ within this cohort.
- Measurement:
- epoch-gpqa-diamond
- Series weight within the test family:
- 50 %
- Nominal contribution to the overall panel:
- 0.51 %
- Raw value:
- 0.9412878787878788 ratio
- Metric:
- choice
- Version:
- 1.0.11
- Participating models:
- 22
- Rank percentile within the cohort:
- 71.4 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- epoch-score-design-v1:["GPQA diamond","GPQA diamond","1.0.11","choice"]
- Reasoning tier:
- high
- Documented comparison setup
- Publication cohort:
- epoch-score-design-v1:["GPQA diamond","GPQA diamond","1.0.11","choice"]
- Dataset type:
- not-reported-in-captured-run-csv
- Setup and model parameters
- Published reasoning tier: high. The capture does not report other inference parameters or a compute budget.
Independent evaluation. Epoch run alias: gemini-3.6-flash_high; Epoch model label: Gemini 3.6 Flash; Display label field: Gemini 3.6 Flash; Reasoning setting encoded in the alias: high. Task ID: GPQA diamond. Task version: 1.0.11. Run ID: 86SY5JbPB49xXhHFQW6tHu. Started at 2026-08-02T00:21:27.000Z. Original task label: GPQA diamond. The published row reports mean_score=0.9412878787878788 and stderr=0.014028967942064968. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: high.
- Epoch AI benchmark run dataset snapshot
Test family: Humanity’s Last Exam
Reasoning · Family index: 67.1 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 50 %
Test family: LMArena Code Arena WebDev
Coding · Family index: 36.1 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: LMArena Text, Style Control
General · Family index: 66.7 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: LMArena Vision, Style Control
Multimodal · Family index: 63.3 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: MMMU-Pro
Multimodal · Family index: 87.4 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: SWE-bench Verified
Coding · Family index: 66.9 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: Terminal-Bench
Coding · Family index: 64.5 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 67 %
Test family: Terminal-Bench Science
Coding · Family index: 27.4 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: BioMysteryBench
General · Family index: 0.0 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: Code Migration
Coding · Family index: 53.2 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: CorpFin v2
Finance · Family index: 60.8 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: CyberBench v1.1
Cybersecurity · Family index: 18.2 / 100Nominal family weight in the overall panel: 7.14 % · Coverage of this test family: 100 %
Test family: EMB
Finance · Family index: 66.1 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Finance Agent (v2)
Finance · Family index: 80.0 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: IOI
Coding · Family index: 9.1 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: LiveCodeBench v6
Coding · Family index: 90.9 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Harvey's Legal Agent Benchmark
Legal · Family index: 52.5 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: LegalBench
Legal · Family index: 88.5 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: Legal Research Bench
Legal · Family index: 33.3 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: MedCode
Health · Family index: 86.6 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MedScribe
Health · Family index: 38.2 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MMLU-Pro
Knowledge · Family index: 85.7 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MortgageTax
Finance · Family index: 65.4 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: ProgramBench
Coding · Family index: 24.5 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: SAGE
Education · Family index: 65.5 / 100Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: Public Benefits Bench v1.1
Productivity · Family index: 15.8 / 100Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: Tax Agent Bench
Finance · Family index: 36.4 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: TaxEval v2
Finance · Family index: 76.3 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Vibe Code Bench v1.1
Coding · Family index: 55.6 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Benchmark sources at a glance
Each evaluator measures different capabilities under its own conditions. Test series, composite indices and their components stay separate. The detailed results below retain their scales, configurations and source dates.
| Evaluator | Test series | Composite indices | Recorded active measurements |
|---|---|---|---|
| Artificial Analysis | 9 | 1 | 12 |
| Vals AI | 26 | 2 | 195 |
| LMArena | 3 | 0 | 42 |
| Epoch AI | 6 | 0 | 9 |
Coverage is not a quality ranking. Overlapping tests and multiple settings do not count as independent experiments. Vendor claims, historical and disputed results are excluded from this overview and remain labelled in the detailed evidence.
Page 1 of 22
Published benchmarks
General tasks
BioMysteryBench
| Sub-task | Gemini 3.6 Flash (This model) | Gemini 3.1 Pro Preview | Gemini 3.8 Flash |
|---|---|---|---|
| Hard | 21.57% | 27.45% (best value in this row) | 21.57% |
| Human-solvable | 67.12% | 67.58% | 71.69% (best value in this row) |
| Overall | 58.52% | 60% | 62.22% (best value in this row) |
higher is betterAs of October 15, 2026Source: Vals AIbars scaled within each row, not across rows
Methodology and context
- Metric
- accuracy
Coding
Code Migration
| Sub-task | Gemini 3.6 Flash (This model) | Gemini 3.8 Flash | Gemini 3.7 Flash | Gemini 3.5 Flash | Gemini 3.1 Pro Preview | Gemini 3 Flash Preview | Gemini 3.5 Flash-Lite | Gemini 3.1 Flash-Lite |
|---|---|---|---|---|---|---|---|---|
| CLI | 19.33% | 25.87% (best value in this row) | 23.54% | 17.18% | 10.83% | 8.52% | 5.88% | 5.73% |
| COBOL | 65.71% | 68.57% (best value in this row) | 68.57% (best value in this row) | 55.46% | 36.75% | 0% | 6.96% | 1.25% |
| Overall | 30.93% | 36.55% (best value in this row) | 34.8% | 26.75% | 17.31% | 6.39% | 6.15% | 4.61% |
higher is betterAs of October 15, 2026Source: Vals AIbars scaled within each row, not across rows
Methodology and context
- Metric
- accuracy
Code Migration
Code Quality
higher is betterAs of October 15, 2026Scale: 0 rating - 3.74 rating
Methodology and context
- Comparison cohort
- vals-code-migration:1:code_quality
- Metric
- mean reviewer code-quality rating
- Scale
- No upper bound is documented. The chart spans the recorded values and zero.
- Participants
- 8
- Methodology and context
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 5404.829. Standard error: 0.073. Cost per task in USD: 8.930416. Score display: 3.299 / 5. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
Finance
CorpFin v2
| Sub-task | Gemini 3.6 Flash (This model) | Gemini 3 Flash Preview | Gemini 3.5 Flash | Gemini 3.1 Pro Preview | Gemini 3.5 Flash-Lite | Gemini 3.1 Flash-Lite |
|---|---|---|---|---|---|---|
| Exact Pages | 61.07% | 68.07% (best value in this row) | 62.82% | 60.84% | 57.46% | 56.64% |
| Max Fitting Context | 65.39% | 63.52% | 66.67% | 66.9% (best value in this row) | 62.35% | 60.61% |
| Overall | 63.33% | 66.43% (best value in this row) | 64.69% | 64.49% | 60.68% | 59.36% |
| Shared Max Context | 63.52% | 67.72% (best value in this row) | 64.57% | 65.73% | 62.24% | 60.84% |
higher is betterAs of October 15, 2026Source: Vals AIbars scaled within each row, not across rows
Methodology and context
- Metric
- accuracy
Recorded measurement details
BioMysteryBench: Hard (Show measurement, test conditions, and source)
- Source value
- 21.569
- Score
- 21.569
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1
- Category
- general
- Task
- human_difficult
- Task label
- Hard
- Direction
- Higher is better
- Comparison cohort
- vals-biomysterybench:1:human_difficult
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-10-12. Harness: Terminus 2. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 761.958. Standard error: 3.922. Cost per task in USD: 1.769118. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-10-15-59bf79d38ec4. Source payload hash: 59bf79d38ec415a34ffb1c2901a16ecbbe101b7fa864e86104d2571fc7cfc23d. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Harness: Terminus 2. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
BioMysteryBench: Human-solvable (Show measurement, test conditions, and source)
- Source value
- 67.123
- Score
- 67.123
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1
- Category
- general
- Task
- human_solvable
- Task label
- Human-solvable
- Direction
- Higher is better
- Comparison cohort
- vals-biomysterybench:1:human_solvable
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-10-12. Harness: Terminus 2. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 761.958. Standard error: 2.852. Cost per task in USD: 1.130257. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-10-15-59bf79d38ec4. Source payload hash: 59bf79d38ec415a34ffb1c2901a16ecbbe101b7fa864e86104d2571fc7cfc23d. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Harness: Terminus 2. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
BioMysteryBench: Overall (Show measurement, test conditions, and source)
- Source value
- 58.519
- Score
- 58.519
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1
- Category
- general
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- vals-biomysterybench:1:overall
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-10-12. Harness: Terminus 2. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 761.958. Standard error: 1.614. Cost per task in USD: 1.252177. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-10-15-59bf79d38ec4. Source payload hash: 59bf79d38ec415a34ffb1c2901a16ecbbe101b7fa864e86104d2571fc7cfc23d. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Harness: Terminus 2. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
Code Migration: CLI (Show measurement, test conditions, and source)
- Source value
- 19.332
- Score
- 19.332
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1
- Category
- coding
- Task
- cli
- Task label
- CLI
- Direction
- Higher is better
- Comparison cohort
- vals-code-migration:1:cli
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 6761.8. Standard error: 2.151. Cost per task in USD: 10.771789. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
Code Migration: COBOL (Show measurement, test conditions, and source)
- Source value
- 65.714
- Score
- 65.714
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1
- Category
- coding
- Task
- cobol
- Task label
- COBOL
- Direction
- Higher is better
- Comparison cohort
- vals-code-migration:1:cobol
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 1333.918. Standard error: 14.938. Cost per task in USD: 3.406297. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
Code Migration: Overall (Show measurement, test conditions, and source)
- Source value
- 30.928
- Score
- 30.928
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1
- Category
- coding
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- vals-code-migration:1:overall
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 5404.829. Standard error: 4.068. Cost per task in USD: 8.930416. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
Code Migration: Code Quality (Show measurement, test conditions, and source)
- Source value
- 3.299
- Score
- 3.299
- Metric
- mean reviewer code-quality rating
- Unit
- rating
- Benchmark version
- 1
- Category
- coding
- Task
- code_quality
- Task label
- Code Quality
- Direction
- Higher is better
- Comparison cohort
- vals-code-migration:1:code_quality
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 5404.829. Standard error: 0.073. Cost per task in USD: 8.930416. Score display: 3.299 / 5. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-10-15-3fa9c10568ec. Source payload hash: 3fa9c10568ecc117fabec81767c405b49a25d5d2ded308ee435fffb197c53474. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
CorpFin v2: Exact Pages (Show measurement, test conditions, and source)
- Source value
- 61.072
- Score
- 61.072
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 2
- Category
- finance
- Task
- exact_pages
- Task label
- Exact Pages
- Direction
- Higher is better
- Comparison cohort
- vals-corp-fin-v2:2:exact_pages
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 4.299. Standard error: 1.665. Cost per task in USD: 0.008536. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
CorpFin v2: Max Fitting Context (Show measurement, test conditions, and source)
- Source value
- 65.385
- Score
- 65.385
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 2
- Category
- finance
- Task
- max_fitting_context
- Task label
- Max Fitting Context
- Direction
- Higher is better
- Comparison cohort
- vals-corp-fin-v2:2:max_fitting_context
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 7.954. Standard error: 1.624. Cost per task in USD: 0.291436. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
CorpFin v2: Overall (Show measurement, test conditions, and source)
- Source value
- 63.326
- Score
- 63.326
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 2
- Category
- finance
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- vals-corp-fin-v2:2:overall
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 6.329. Standard error: 0.949. Cost per task in USD: 0.136842. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
CorpFin v2: Shared Max Context (Show measurement, test conditions, and source)
- Source value
- 63.52
- Score
- 63.52
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 2
- Category
- finance
- Task
- shared_max_context
- Task label
- Shared Max Context
- Direction
- Higher is better
- Comparison cohort
- vals-corp-fin-v2:2:shared_max_context
- Source type
- independent-evaluator
- Evaluator
- Vals AI
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Source model ID: google/gemini-3.6-flash. Source model name: Gemini 3.6 Flash. Provider reported by source: Google. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-12. Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536. Latency in seconds: 6.733. Standard error: 1.643. Cost per task in USD: 0.110554. Source ID: vals-ai. Evidence capture ID: vals-corp_fin_v2-2026-10-15-7cf2217ab372. Source payload hash: 7cf2217ab3728d5a84bffce82aab9fc52d7f810b0cbe8c65b387df47f3d31c9b. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Comparison methodology
- Reasoning effort: high. Temperature: 1. Maximum output tokens: 65536
Page 1 of 22
Our tests
SVG short test
One SVG prompt and fixed output settings. Captures are shown only with 0 reported reasoning tokens or documented lack of reasoning controls. Identical test conditions do not make the models' internal compute identical.
Earlier tests
Pelican on a bicycle
A community classic for free-form SVG drawing.
Gemini 3.6 Flash
The response reached the token limit. No complete recording is available.
Reasoning (requested): high
Current attempt
- Run date
- Oct 5, 2026
- API provider
- openrouter
- Requested API model
- google/gemini-3.6-flash
- API model reported in response
- google/gemini-3.6-flash
- Reasoning setting
- high
- Pinned endpoint
- Google AI Studio | google/gemini-3.6-flash-20260721
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Test protocol
- community-visual-tests-v1
- Technical checks
- Failed
- Response time
- 39.6 s
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Earlier attempts (3)
- Oct 2, 2026API request failedReasoning setting: high
- Oct 1, 2026API request failedReasoning setting: high
- Sep 7, 2026API request failedReasoning setting: high
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)Popularity
38.9 / 100
Specifications and access
| Specification | Value and source |
|---|---|
| Weights | ProprietarySource |
| Access | APISource |
| Context window | 1,048,576 tokensSource |
| Knowledge cutoff | March 2026Source |
| Notes | Released July 21, 2026. Google does not publish its parameter count or architecture; the model card states a March 2026 knowledge cutoff.Source |
| API model ID | gemini-3.6-flashSource |
| Source status | stableSource |
| Maximum output | 65,536 tokensSource |
| Input | Text, Image, Video, Audio, pdfSource |
| Output | TextSource |
| Reasoning mode | low, medium, highSource |
| Tool calling | YesSource |
| Structured output | YesSource |
| Release | 2026-07-21Source |
| Capabilities | function calling, structured outputs, search grounding, Google Maps grounding, URL context, code execution, file search, computer useSource |
| General availability | 2026-07-21 (General availability (GA).)Source |