Head-to-head comparison

GPT-5.4 mini vs. Gemini 3.7 Flash

Compare published benchmark results from matching versions and cohorts, API pricing, and technical specifications. Any documented test setup differences remain visible.

shared result series: 17
distinct benchmarks: 17
latest retrieval: 2026-09-04

First modelSecond model

Specifications

General specifications

Release date, availability, context window, architecture, and published parameter counts at a glance. Undisclosed details remain marked as unavailable.

Specifications for GPT-5.4 mini and Gemini 3.7 Flash
Attribute	GPT-5.4 mini	Gemini 3.7 Flash
Provider	OpenAI	Google
Released	Mar 17, 2026	Aug 13, 2026
Availability	Active	Active
Model type	Proprietary	Proprietary
Parameters	Not published	Not published
Architecture	Not published	Not published
Context window	400,000 tokens	1,048,576 tokens
Knowledge cutoff	August 31, 2025	March 2026
Technical sources	Model	Model, Knowledge cutoff

Pricing

API pricing compared

The table compares official standard API rates per 1M tokens, including published cache pricing. Batch, fast, priority, regional surcharges, tool calls, and cloud platform pricing are excluded.

API pricing for GPT-5.4 mini and Gemini 3.7 Flash
Price type	GPT-5.4 mini	Gemini 3.7 Flash
API input	$0.75	$0.75
API output	$4.5	$3.75
Cache read	$0.07	$0.07
Cache write (5 min.)	Not listed	Not listed
Cache write (1 hr.)	Not listed	Not listed
Price verified	07/30/2026 Source	08/16/2026 Source

GPT-5.4 miniGemini 3.7 Flash

API inputUSD per 1M tokens, base tier

GPT-5.4 mini$0.75

Gemini 3.7 Flash$0.75

API outputUSD per 1M tokens, base tier

GPT-5.4 mini$4.5

Gemini 3.7 Flash$3.75

Cache readUSD per 1M tokens, base tier

GPT-5.4 mini$0.075

Gemini 3.7 Flash$0.075

Key to the marks:better valuebetter, but not conclusivetie

Pricing by provider

Direct developer pricing and provider endpoint tariffs routed through OpenRouter are listed separately. Prices are in USD per 1M tokens. Context-dependent direct tiers plus regional, Flex, Priority, and other OpenRouter tariffs remain individually identifiable.

Provider pricing for GPT-5.4 mini and Gemini 3.7 Flash
Model	Provider	Purchase route and tariff	Input per 1M tokens	Output per 1M tokens	Source
GPT-5.4 mini	OpenAI	Direct from developerStandard API	$0.75	$4.5	Source07/30/2026
	Azure	Via OpenRouterazure	$0.75	$4.5	Source09/08/2026
	Azure	Via OpenRouterazure/us	$0.825	$4.95	Source09/08/2026
	OpenAI	Via OpenRouteropenai	$0.75	$4.5	Source09/08/2026
	OpenAI	Via OpenRouteropenai/fast	$1.5	$9	Source09/08/2026
	OpenAI	Via OpenRouteropenai/flex	Lowest listed price: $0.375	Lowest listed price: $2.25	Source09/08/2026
Gemini 3.7 Flash	Google	Direct from developerStandard API	$0.75	$3.75	Source08/16/2026
	Google	Via OpenRoutergoogle-vertex/global	$0.75	$3.75	Source09/08/2026
	Google	Via OpenRoutergoogle-vertex/global/flex	Lowest listed price: $0.375	Lowest listed price: $1.875	Source09/08/2026
	Google	Via OpenRoutergoogle-vertex/global/priority	$1.35	$6.75	Source09/08/2026
	Google AI Studio	Via OpenRoutergoogle-ai-studio	$0.75	$3.75	Source09/08/2026
	Google AI Studio	Via OpenRoutergoogle-ai-studio/flex	Lowest listed price: $0.375	Lowest listed price: $1.875	Source09/08/2026
	Google AI Studio	Via OpenRoutergoogle-ai-studio/priority	$1.35	$6.75	Source09/08/2026

Performance

Shared benchmarks

Only published results with the same benchmark version, task, metric, and comparison cohort are paired. Different reasoning levels, agents, harnesses, or output limits appear directly in the table.

Capability profile from matched benchmarks

Each axis averages directly matched benchmark families. A value of 100 means the stronger value within this pair, not a universal quality score.

GPT-5.4 mini

Gemini 3.7 Flash

Coding: 77.5 / 100 (5 benchmark families)

Reasoning: 88.4 / 100 (1 benchmark family)

Knowledge: 93.8 / 100 (1 benchmark family)

Finance: 82.8 / 100 (4 benchmark families)

Legal: 18.1 / 100 (2 benchmark families)

Agentic tasks: 70.5 / 100 (1 benchmark family)

Multimodal: 89.1 / 100 (1 benchmark family)

Education: 100 / 96.9 (1 benchmark family)

17 matched rows from 17 benchmark families were considered. The radar shows 8 of 9 comparable categories.

GPT-5.4 miniGemini 3.7 Flash

Code MigrationOverall. Higher is better. No documented setup difference

GPT-5.4 mini12.936 %

Gemini 3.7 Flash34.8 %

EMBOverall. Higher is better. No documented setup difference

GPT-5.4 mini45.426 %

Gemini 3.7 Flash71.326 %

Finance Agent (v2)Overall. Higher is better. No documented setup difference

GPT-5.4 mini45.36 %

Gemini 3.7 Flash59.042 %

GPQA DiamondOverall. Higher is better. No documented setup difference

GPT-5.4 mini83.08 %

Gemini 3.7 Flash93.94 %

Harvey's Legal Agent BenchmarkOverall · Task fully resolved. Higher is better. No documented setup difference

GPT-5.4 mini0 %

Gemini 3.7 Flash8.75 %

Legal Research BenchOverall · All-pass. Higher is better. No documented setup difference

GPT-5.4 mini12.5 %

Gemini 3.7 Flash34.615 %

LiveCodeBench v6Overall. Higher is better. No documented setup difference

GPT-5.4 mini81.465 %

Gemini 3.7 Flash88.652 %

MMLU-ProOverall. Higher is better. No documented setup difference

GPT-5.4 mini84.554 %

Gemini 3.7 Flash90.121 %

MMMU-ProOverall. Higher is better. No documented setup difference

GPT-5.4 mini79.249 %

Gemini 3.7 Flash88.96 %

MortgageTaxOverall. Higher is better. No documented setup difference

GPT-5.4 mini63.514 %

Gemini 3.7 Flash66.654 %

ProgramBenchOverall. Higher is better. No documented setup difference

GPT-5.4 mini0 %

Gemini 3.7 Flash0 %

SAGEOverall. Higher is better. No documented setup difference

GPT-5.4 mini50.813 %

Gemini 3.7 Flash49.232 %

Key to the marks:better valuebetter, but not conclusivetie

Benchmark scores for GPT-5.4 mini and Gemini 3.7 Flash
Benchmark and task	GPT-5.4 mini	Gemini 3.7 Flash	Source
Code MigrationOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	12.936 %	Winner34.8 %	Vals AI Source details Data as of: 09/03/2026
EMBOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	45.426 %	Winner71.326 %	Vals AI Source details Data as of: 09/03/2026
Finance Agent (v2)Overall Test details No documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	45.36 %	Winner59.042 %	Vals AI Source details Data as of: 09/03/2026
GPQA DiamondOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	83.08 %	Winner93.94 %	Vals AI Source details Data as of: 09/01/2026
Harvey's Legal Agent BenchmarkOverall · Task fully resolved Test details No documented difference in the test setupVersion: 1Metric: task resolution rateScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	0 %	Winner8.75 %	Vals AI Source details Data as of: 09/03/2026
Legal Research BenchOverall · All-pass Test details No documented difference in the test setupVersion: 1Metric: all-pass rateScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	12.5 %	Winner34.615 %	Vals AI Source details Data as of: 09/03/2026
LiveCodeBench v6Overall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	81.465 %	Winner88.652 %	Vals AI Source details Data as of: 09/01/2026
MMLU-ProOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	84.554 %	Winner90.121 %	Vals AI Source details Data as of: 09/01/2026
MMMU-ProOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	79.249 %	Winner88.96 %	Vals AI Source details Data as of: 09/01/2026
MortgageTaxOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	63.514 %	Winner66.654 %	Vals AI Source details Data as of: 09/01/2026
ProgramBenchOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	Tie0 %	Tie0 %	Vals AI Source details Data as of: 09/01/2026
SAGEOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	Winner50.813 %	49.232 %	Vals AI Source details Data as of: 09/03/2026
SWE-bench VerifiedOverall Test details No documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	73 %	Winner80.8 %	Vals AI Source details Data as of: 09/01/2026
TaxEval v2Overall Test details No documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	71.218 %	Winner74.734 %	Vals AI Source details Data as of: 09/01/2026
Terminal-Bench 2.1Overall Test details No documented difference in the test setupVersion: 2.1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	54.682 %	Winner77.528 %	Vals AI Source details Data as of: 09/03/2026
Vals IndexOverall Test details No documented difference in the test setupVersion: 2Metric: weighted index scoreScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17	39.632 %	Winner59.307 %	Vals AI Source details Data as of: 09/03/2026
Vibe Code Bench v1.1Overall Test details No documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is betterGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17, Harness: OpenHands Gemini 3.7 Flash: Harness: OpenHands	47.969 %	Winner70.395 %	Vals AI Source details Data as of: 09/03/2026
Key to the marks:better valuebetter, but not conclusivetie

Our model tests

Community tests you can inspect

Compare how the models respond to the same prompt. Each test shows the first attempt, with no subsequent fixes to the generated code. These results do not contribute to an overall score.

Pelican on a bicycle

A community classic for free-form SVG drawing.

GPT-5.4 mini

The response reached the token limit. No complete recording is available.

First attempt

Run date: 7 Sept 2026
API provider: openrouter
Requested API model: openai/gpt-5.4-mini
API model reported in response: openai/gpt-5.4-mini
Pinned endpoint: OpenAI | openai/gpt-5.4-mini-20260317
Reasoning setting: high
Temperature: Provider default
Token limit including reasoning: 8,192 tokens
Test protocol: community-visual-tests-v1
Technical checks: Failed
Response time: 67 s

Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.

Gemini 3.7 Flash

API access was unavailable for this run. The model was not evaluated.

First attempt

Run date: 7 Sept 2026
API provider: openrouter
Requested API model: google/gemini-3.7-flash
Pinned endpoint: Google AI Studio | google/gemini-3.7-flash-20260813
Reasoning setting: high
Temperature: Provider default
Token limit including reasoning: 8,192 tokens
Test protocol: community-visual-tests-v1
Technical checks: Not run

Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

How to read this comparison

Winning one benchmark is not an overall verdict

Your workload, budget, and required context length matter most. A coding benchmark says little about visual understanding or agent performance.

The standard price table uses direct developer rates. The provider comparison labels OpenRouter endpoints, regions, and special tariffs separately.

Every result links to its measurement source and retrieval date. Labels distinguish vendor reports, official benchmark leaderboards, and independent evaluations. Disputed or archived results are excluded.

More matchups

Compare GPT-5.4 mini and Gemini 3.7 Flash with other leading models using the same data and benchmark logic.

View the complete LLM comparison