Head-to-head comparison
GPT-5.4 mini vs. Gemini 3.7 Flash
Compare published benchmark results from matching versions and cohorts, API pricing, and technical specifications. Any documented test setup differences remain visible.
7
shared result series
7
distinct benchmarks
2026-08-16
latest retrieval
Change model selection
Specifications and cost
General specifications and standard API pricing
Undisclosed parameter counts and knowledge cutoffs stay marked as unavailable. The table shows direct standard token pricing, including documented context tiers. Batch, fast, priority, regional surcharges, tool calls, and cloud platform pricing are excluded.
| Attribute | GPT-5.4 mini | Gemini 3.7 Flash |
|---|---|---|
| Provider | OpenAI | |
| Released | Mar 2026 | Aug 13, 2026 |
| Availability | Active | Active |
| Model type | Proprietary | Proprietary |
| Parameters | Not published | Not published |
| Architecture | Not published | Not published |
| Context window | 400,000 tokens | 1,048,576 tokens |
| Knowledge cutoff | August 31, 2025 | March 2026 |
| Technical sources | Model | Model, Knowledge cutoff |
| API pricing per 1M tokens | ||
| API input | $0.75 | $0.75 |
| API output | $4.5 | $3.75 |
| Cache read | $0.07 | $0.07 |
| Cache write (5 min.) | Not listed | Not listed |
| Cache write (1 hr.) | Not listed | Not listed |
| Price verified | 07/30/2026Source | 08/16/2026Source |
Performance
Shared benchmarks
Only published results with the same benchmark version, task, metric, and comparison cohort are paired. Different reasoning levels, agents, harnesses, or output limits appear directly in the table.
| Benchmark and task | GPT-5.4 mini | Gemini 3.7 Flash | Comparability | Source |
|---|---|---|---|---|
| EMBOverall | 45.426 % | 71.326 %Winner | 1accuracyHigher is betterCohort: vals-emb:1:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17 Gemini 3.7 Flash: No further settings disclosed | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-13Import ID: vals-emb-2026-08-16-68d5d1d47a97Retrieved 2026-08-16 |
| Finance Agent (v2)Overall | 45.36 % | 59.042 %Winner | 2accuracyHigher is betterCohort: vals-finance-agent-v2:2:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17 Gemini 3.7 Flash: No further settings disclosed | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-14Import ID: vals-fabv2-2026-08-16-8853da43085dRetrieved 2026-08-16 |
| Harvey's Legal Agent BenchmarkOverall · Task fully resolved | 0 % | 8.75 %Winner | 1task resolution rateHigher is betterCohort: vals-legal-agent-benchmark:1:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17 Gemini 3.7 Flash: No further settings disclosed | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-14Import ID: vals-hlab-2026-08-16-bae90566df2fRetrieved 2026-08-16 |
| Legal Research BenchOverall · All-pass | 12.5 % | 34.615 %Winner | 1all-pass rateHigher is betterCohort: vals-legal-research:1:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17 Gemini 3.7 Flash: No further settings disclosed | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-14Import ID: vals-legal_research-2026-08-16-af296c00ecaaRetrieved 2026-08-16 |
| Terminal-Bench 2.1Overall | 54.682 % | 77.528 %Winner | 2.1accuracyHigher is betterCohort: vals-terminal-bench-2-1:2.1:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17 Gemini 3.7 Flash: No further settings disclosed | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-13Import ID: vals-terminal-bench-2-1-2026-08-16-b3f38c18bea4Retrieved 2026-08-16 |
| Vals IndexOverall | 39.632 % | 59.307 %Winner | 2weighted index scoreHigher is betterCohort: vals-vals-index:2:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17 Gemini 3.7 Flash: No further settings disclosed | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-14Import ID: vals-vals_index-2026-08-16-ab641d89d6edRetrieved 2026-08-16 |
| Vibe Code Bench v1.1Overall | 47.969 % | 70.395 %Winner | 1.1accuracyHigher is betterCohort: vals-vibe-code-bench:1.1:overallNo documented setup differenceWinner: Gemini 3.7 FlashGPT-5.4 mini: Snapshot: gpt-5.4-mini-2026-03-17, Harness: OpenHands Gemini 3.7 Flash: Harness: OpenHands | Vals AIType: Independent evaluationLeaderboard updated: 2026-08-13Import ID: vals-vibe-code-2026-08-16-a73c9770bcc4Retrieved 2026-08-16 |
How to read this comparison
Winning one benchmark is not an overall verdict
Your workload, budget, and required context length matter most. A coding benchmark says little about visual understanding or agent performance.
Prices use official API rates per 1M tokens. Web subscriptions and cloud platform surcharges can differ.
Every result links to its measurement source and retrieval date. Labels distinguish vendor reports, official benchmark leaderboards, and independent evaluations. Disputed or archived results are excluded.
More matchups
Related LLM comparisons
Compare GPT-5.4 mini and Gemini 3.7 Flash with other leading models using the same data and benchmark logic.
View the complete LLM comparison