- Home
- LLM comparison
- GPT-5.4 mini vs. Gemini 3.7 Flash
OpenAIGoogleLLM matchup
GPT-5.4 minivs.Gemini 3.7 Flash
Which one is better?
Gemini 3.7 Flash performs better than GPT-5.4 mini.
GPT-5.4 mini
Rank 62
Gemini 3.7 Flash
Rank 17
GPT-5.4 mini
Gemini 3.7 Flash
GPT-5.4 mini
Gemini 3.7 Flash
No clear advantage for GPT-5.4 mini.
Choose Gemini 3.7 Flash for
Compare other versions
Keep comparing
On this page
Where is the difference?
Strengths at a glance
GPT-5.4 miniGemini 3.7 FlashMedian of all ranked models
95 % range: GPT-5.4 mini 70.9 to 80.5, Gemini 3.7 Flash 93.1 to 102.2.
The same values and verdicts as the bars below. In the close-up the net starts at 70 points, just below the weaker model's lowest value; the reference group average is 100. Not in the net because a model has no own value there or the data are too thin: Reasoning, Mathematics, Knowledge, Legal, Health.
Gemini 3.7 Flash is ahead in 5 of 10 areas, GPT-5.4 mini in none.
too little data: 5Gemini 3.7 Flash ahead: 5
Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.
Show 1 more areas that do not count toward the overall index
Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.
Which model for which task?
Everyday tasks, translated from the area values above. Each row names the values it rests on.
GPT-5.4 mini vs. Gemini 3.7 Flash in our own test
The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.
GPT-5.4 mini

Oct 2, 2026 · 14 s · $0.01
Test details
- Run date
- Oct 2, 2026
- API provider
- openrouter
- Requested API model
- openai/gpt-5.4-mini
- Reasoning setting
- high
- Token limit including reasoning
- 8,192 tokens
- Output tokens
- 3,142 tokens
- Cost of the attempt
- $0.0142
- Response time
- 13.5 s
- API model reported in response
- openai/gpt-5.4-mini
- Pinned endpoint
- OpenAI | openai/gpt-5.4-mini-20260317
- Temperature
- Provider default
- Test protocol
- community-visual-tests-v1
- Technical checks
- Passed, not a quality rating
Visually reviewed. This individual test does not establish overall model quality.
Earlier attempts (2)
- Oct 1, 2026API request failedReasoning setting: high
- Sep 7, 2026API request failedReasoning setting: high
Gemini 3.7 Flash
The response reached the token limit. No complete recording is available.
Oct 5, 2026 · 29 s · $0.03
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Test details
- Run date
- Oct 5, 2026
- API provider
- openrouter
- Requested API model
- google/gemini-3.7-flash
- Reasoning setting
- high
- Token limit including reasoning
- 8,192 tokens
- Output tokens
- 8,188 tokens
- Cost of the attempt
- $0.0307
- Response time
- 28.8 s
- API model reported in response
- google/gemini-3.7-flash
- Pinned endpoint
- Google AI Studio | google/gemini-3.7-flash-20260813
- Temperature
- Provider default
- Test protocol
- community-visual-tests-v1
- Technical checks
- Failed
Earlier attempts (3)
- Oct 2, 2026API request failedReasoning setting: high
- Oct 1, 2026API request failedReasoning setting: high
- Sep 7, 2026API request failedReasoning setting: high
SVG short test
SVG short test
One SVG task with the same fixed settings for every model, without hidden thinking.
Prompt
Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.
GPT-5.4 mini
Unavailable in this round
Gemini 3.7 Flash
Unavailable in this round
GPT-5.4 mini and Gemini 3.7 Flash in the overall index
Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.
Overall index (Gradually Meta-Score v6)
20 of 95 models
All data side by side
The better value is bold. For the overall index only when the gap is clear.
| Metric | GPT-5.4 mini | Gemini 3.7 Flash |
|---|---|---|
| Intelligence | ||
| Overall indexpoints, 100 = reference group average, higher is better | 75.1 | 107.7 |
| Rank | Rank 62 of 95 | Rank 17 of 95 |
| Price per 1M tokens | ||
| Inputwhat you send | $0.75 | n/a |
| Outputwhat the model writes | $4.50 | n/a |
| Speed | ||
| Tokens per second | 97 | 76 |
| Technical | ||
| Context windowhow much text the model reads at once | 400,000 tokens≈ 600 A4 pages | 1.05 M tokens≈ 1,570 A4 pages |
| Knowledge cutoff | Aug 31, 2025 | March 2026 |
| Released | Mar 17, 2026 | Aug 13, 2026 |
| Availability | Active | Discontinued |
| Open weights | no | no |
Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis
Is there a better choice?
Overall index 106.4, rank 20$0.75 input and $3.75 output per 1M tokens
GPT-5.4 mini vs. Gemini 3.8 FlashOverall index 130.9, rank 1$8 input and $40 output per 1M tokens
View profileShared benchmarks
Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.
A: GPT-5.4 miniB: Gemini 3.7 Flash
Show 54 more benchmarks
More comparisons
Compare GPT-5.4 mini and Gemini 3.7 Flash with the models people compare them with most often.
Compare another matchup
Predecessor and successor
The most popular comparisons
- 1GPT-6 Luna vs. GPT-5.4 mini
- 2GPT-5.6 Luna vs. GPT-5.4 mini
- 3Claude Haiku 5.5 vs. GPT-5.4 mini
- 4GPT-5.4 mini vs. Gemini 3.8 Flash
- 5Gemini 3.7 Flash vs. Qwen 3.8 27B
- 6GPT-5.4 mini vs. Qwen 3.8 27B
- 7GPT-6 Luna vs. Gemini 3.7 Flash
- 8GPT-5.4 mini vs. DeepSeek-V4-Flash
- 9Claude Sonnet 5.5 vs. GPT-5.4 mini
Show all 23 comparisons
- 10Gemini 3.7 Flash vs. DeepSeek-V4-Flash
- 11Claude Haiku 5.5 vs. Gemini 3.7 Flash
- 12GPT-5.6 Luna vs. Gemini 3.7 Flash
- 13Claude Sonnet 5.5 vs. Gemini 3.7 Flash
- 14Claude Sonnet 5 vs. Gemini 3.7 Flash
- 15Gemini 3.7 Flash vs. Gemini 3.5 Flash-Lite
- 16Gemini 3.7 Flash vs. Qwen 3.8 Max 0902
- 17GPT-5.6 Terra vs. Gemini 3.7 Flash
- 18Claude Sonnet 4.6 vs. Gemini 3.7 Flash
- 19Claude Opus 4.6 vs. Gemini 3.7 Flash
- 20GPT-6.1 Sol vs. GPT-5.4 mini
- 21GPT-6.1 Terra vs. GPT-5.4 mini
- 22Gemini 4 Carbon vs. Gemini 3.7 Flash
- 23GPT-6.1 Sol vs. Gemini 3.7 Flash