Skip to main content

OpenAIGoogleLLM matchup

GPT-5.4vs.Gemini 3.5 Flash-Lite

Which one is better?

GPT-5.4 performs better than Gemini 3.5 Flash-Lite, but costs 8.3 times (input) and 6 times (output) as much.

GPT-5.4 ahead
IntelligenceOverall index, 100 points = average
86.4

GPT-5.4

Rank 50

72.4

Gemini 3.5 Flash-Lite

Rank 67

Gemini 3.5 Flash-Lite faster
SpeedTokens per second
64

GPT-5.4

135

Gemini 3.5 Flash-Lite

Gemini 3.5 Flash-Lite cheaper
Price$ per 1M tokens
$5.63

GPT-5.4

$0.85

Gemini 3.5 Flash-Lite

Popularity0 to 100
n/a

GPT-5.4

71

Gemini 3.5 Flash-Lite

Rank 38 of 508

Above 272,000 tokens of context, GPT-5.4 costs more: $5 input and $22.50 output per 1M tokens.

Choose GPT-5.4 for

AgentsCodingReasoningLegalFinanceHealth (not certain)Multimodal (not certain)

No clear advantage for Gemini 3.5 Flash-Lite.

Where is the difference?

Strengths at a glance

GPT-5.4Gemini 3.5 Flash-LiteMedian of all ranked models

8010060CodingGPT-5.4ReasoningGPT-5.4AgentsGPT-5.4MultimodalslightlyGPT-5.4FinanceGPT-5.4LegalGPT-5.4HealthslightlyGPT-5.4
CodingGPT-5.4 ahead
GPT-5.485.0Rank 60
Gemini 3.5 Flash-Lite68.6Rank 81
Median of ranked models87.5

95 % range: GPT-5.4 75.3 to 94.6, Gemini 3.5 Flash-Lite 62.4 to 74.8.

AreaGPT-5.4Gemini 3.5 Flash-Lite

The same values and verdicts as the bars below. In the close-up the net starts at 60 points, just below the weaker model's lowest value; the reference group average is 100. Not in the net because a model has no own value there or the data are too thin: Mathematics, Knowledge, General.

GPT-5.4 is ahead in 5 of 9 areas, Gemini 3.5 Flash-Lite in none.

GPT-5.4 ahead: 5GPT-5.4 slightly ahead: 2too little data: 2

Areas in the overall index
AgentsGPT-5.4 +2190.5 to 69.9
CodingGPT-5.4 +1685.0 to 68.6
ReasoningGPT-5.4 +1687.9 to 71.6
Multimodalleaning GPT-5.4not certain · 4 and 3 tests
Generaltoo little data86.1 to 64.0
Knowledgetoo little data87.0 to 77.9
Specialist fields
LegalGPT-5.4 +1183.9 to 72.5
FinanceGPT-5.4 +1185.9 to 74.7
Healthleaning GPT-5.4not certain · 3 and 2 tests

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Show 3 more areas that do not count toward the overall index
Cybersecurityonly Gemini 3.5 Flash-Lite has a score
Productivityonly Gemini 3.5 Flash-Lite has a score
Educationonly Gemini 3.5 Flash-Lite has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Which model for which task?

Everyday tasks, translated from the area values above. Each row names the values it rests on.

Writing and debugging codeGPT-5.4Coding 85.0 to 68.6
Maths and data analysisGPT-5.4Reasoning 87.9 to 71.6
Facts and researchopenKnowledge 87.0 to 77.9 (too little data)
Agents and workflowsGPT-5.4Agents 90.5 to 69.9
Fast chat repliesGemini 3.5 Flash-Lite64 to 135 tokens per second
Security analysisopenCybersecurity without a score for GPT-5.4
Many requests on a small budgetGemini 3.5 Flash-Lite$5.63 to $0.85 per 1M tokens
Finance, legal and medical textsGPT-5.4Finance 85.9 to 74.7, Legal 83.9 to 72.5, Health 80.4 to 72.8
Images, screenshots and PDFsleaning GPT-5.4Multimodal 88.8 to 83.6

GPT-5.4 vs. Gemini 3.5 Flash-Lite in our own test

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Task origin: Simon Willison

GPT-5.4

GPT-5.4: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 1, 2026 · 117 s · $0.11

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
openai/gpt-5.4
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
7,339 tokens
Cost of the attempt
$0.1101
Response time
116.8 s
API model reported in response
openai/gpt-5.4
Pinned endpoint
OpenAI | openai/gpt-5.4-20260305
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (1)

  • Sep 7, 2026API request failedReasoning setting: high

Gemini 3.5 Flash-Lite

Gemini 3.5 Flash-Lite: Pelican on a bicycle
A community classic for free-form SVG drawing.

Oct 2, 2026 · 14 s · $0.01

Test details
Run date
Oct 2, 2026
API provider
openrouter
Requested API model
google/gemini-3.5-flash-lite
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
5,414 tokens
Cost of the attempt
$0.0135
Response time
14.3 s
API model reported in response
google/gemini-3.5-flash-lite
Pinned endpoint
Google AI Studio | google/gemini-3.5-flash-lite-20260721
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Earlier attempts (2)

  • Oct 1, 2026API request failedReasoning setting: high
  • Sep 7, 2026API request failedReasoning setting: high
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Prompt

Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.

GPT-5.4

Unavailable in this round

Gemini 3.5 Flash-Lite

Unavailable in this round

GPT-5.4 and Gemini 3.5 Flash-Lite in the overall index

Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.

Overall index (Gradually Meta-Score v6)

20 of 95 models

Claude Fable 5.2max130.9
Gemini 4 Carbonhigh127.0
Claude Opus 5.5max125.7
Claude Fable 5.1max124.1
Claude Sonnet 5.5max121.9
Gemini 4 Argonhigh121.2
GPT-6 Astramax119.6
Muse Wonder Fullmax118.4
GPT-6.1 Solmax117.5
Claude Opus 5max117.3
Muse Wondermax113.7
Claude Fable 5max112.8
Kimi K3.1 Promax112.6
Muse Ember 1.0max110.5
GPT-5.6 Solmax109.3
GPT-6 Solmax108.4
Gemini 3.7 Flashhigh107.7
DeepSeek V4.1 Flash 1017max107.1
GPT-5.4xhigh86.4
Gemini 3.5 Flash-Litehigh72.4

Popularity compared

How often the models are searched for, used and mentioned, on a scale from 0 to 100.

GPT-5.4 has no popularity score yet.

Over time

Weekly values from October 18, 2026 to November 16, 2026

GPT-5.4Gemini 3.5 Flash-Lite

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricGPT-5.4Gemini 3.5 Flash-Lite
Intelligence
Overall indexpoints, 100 = reference group average, higher is better86.472.4
RankRank 50 of 95Rank 67 of 95
Price per 1M tokens
Inputwhat you send$2.50above 272,000 tokens: $5$0.30
Outputwhat the model writes$15above 272,000 tokens: $22.50$2.50
Cost per task (own tests)average of 3 original-protocol tasks both models passed (SVG short test not included)$0.19$0.022
Speed
Tokens per second64135
Popularity
Popularitysearch, usage and mentions, 0 to 100n/a71Rank 38 of 508
Technical
Context windowhow much text the model reads at once1.05 M tokens≈ 1,580 A4 pages1.05 M tokens≈ 1,570 A4 pages
Knowledge cutoffAug 31, 2025n/a
ReleasedMar 5, 2026Jul 21, 2026
AvailabilityActiveActive
Open weightsnono

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Is there a better choice?

Successor of GPT-5.4GPT-5.5

Overall index 101.4, rank 27$5 input and $30 output per 1M tokens

Gemini 3.5 Flash-Lite vs. GPT-5.5
Cheaper than Gemini 3.5 Flash-LiteMuse Ember 1.0

Overall index 110.5, rank 14$0.10 input and $0.50 output per 1M tokens

View profile
Best model in the overall indexClaude Fable 5.2

Overall index 130.9, rank 1$8 input and $40 output per 1M tokens

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: GPT-5.4B: Gemini 3.5 Flash-Lite

Code MigrationOverall · higher is betterTest setup not documented as identicalGPT-5.4: 35.0%Gemini 3.5 Flash-Lite: 6.1%Vals AIAs of 10/29/2026
CorpFin v2Overall · higher is betterTest setup not documented as identicalGPT-5.4: 65.3%Gemini 3.5 Flash-Lite: 60.7%Vals AIAs of 08/12/2026
GPQA DiamondOverall · higher is betterTest setup not documented as identicalGPT-5.4: 91.7%Gemini 3.5 Flash-Lite: 83.8%Vals AIAs of 09/01/2026
LegalBenchOverall · higher is betterTest setup not documented as identicalGPT-5.4: 86.0%Gemini 3.5 Flash-Lite: 84.1%Vals AIAs of 10/13/2026
LiveCodeBenchOverall · higher is betterTest setup not documented as identicalGPT-5.4: 84.1%Gemini 3.5 Flash-Lite: 79.0%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevOverall · higher is betterGPT-5.4: 1,400Gemini 3.5 Flash-Lite: 1,432LMArenaAs of 11/15/2026
LMArena Text, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.4: 1,475Gemini 3.5 Flash-Lite: 1,455LMArenaAs of 11/11/2026
LMArena Vision, Style ControlOverall · higher is betterTest setup not documented as identicalGPT-5.4: 1,282Gemini 3.5 Flash-Lite: 1,266LMArenaAs of 11/09/2026
MedCodeOverall · higher is betterTest setup not documented as identicalGPT-5.4: 41.3%Gemini 3.5 Flash-Lite: 43.5%Vals AIAs of 10/29/2026
MedScribeOverall · higher is betterTest setup not documented as identicalGPT-5.4: 77.5%Gemini 3.5 Flash-Lite: 70.9%Vals AIAs of 10/29/2026
Show 54 more benchmarks
MMLU ProOverall · higher is betterTest setup not documented as identicalGPT-5.4: 87.5%Gemini 3.5 Flash-Lite: 85.8%Vals AIAs of 09/01/2026
MMMU ProOverall · higher is betterTest setup not documented as identicalGPT-5.4: 87.5%Gemini 3.5 Flash-Lite: 83.6%Vals AIAs of 09/01/2026
MortgageTaxOverall · higher is betterTest setup not documented as identicalGPT-5.4: 68.3%Gemini 3.5 Flash-Lite: 68.7%Vals AIAs of 09/01/2026
ProgramBenchOverall · higher is betterTest setup not documented as identicalGPT-5.4: 0%Gemini 3.5 Flash-Lite: 0%Vals AIAs of 11/05/2026
SWE-bench VerifiedOverall · higher is betterTest setup not documented as identicalGPT-5.4: 78.2%Gemini 3.5 Flash-Lite: 75.0%Vals AIAs of 09/01/2026
TaxEval v2Overall · higher is betterTest setup not documented as identicalGPT-5.4: 74.0%Gemini 3.5 Flash-Lite: 72.6%Vals AIAs of 09/01/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalGPT-5.4: 67.4%Gemini 3.5 Flash-Lite: 37.2%Vals AIAs of 11/05/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalGPT-5.4: 23.8%Gemini 3.5 Flash-Lite: 5.9%Vals AIAs of 10/29/2026
CorpFin v2Exact Pages · higher is betterTest setup not documented as identicalGPT-5.4: 64.1%Gemini 3.5 Flash-Lite: 57.5%Vals AIAs of 08/12/2026
GPQA DiamondFew-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.4: 91.4%Gemini 3.5 Flash-Lite: 81.8%Vals AIAs of 09/01/2026
LegalBenchConclusion Tasks · higher is betterTest setup not documented as identicalGPT-5.4: 88.9%Gemini 3.5 Flash-Lite: 88.4%Vals AIAs of 10/13/2026
LiveCodeBenchEasy · higher is betterTest setup not documented as identicalGPT-5.4: 99.1%Gemini 3.5 Flash-Lite: 98.8%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevImage to WebDev · higher is betterGPT-5.4: 1,441Gemini 3.5 Flash-Lite: 1,449LMArenaAs of 11/15/2026
LMArena Text, Style ControlBusiness, management and finance · higher is betterTest setup not documented as identicalGPT-5.4: 1,482Gemini 3.5 Flash-Lite: 1,453LMArenaAs of 11/11/2026
LMArena Vision, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.4: 1,317Gemini 3.5 Flash-Lite: 1,306LMArenaAs of 11/09/2026
MMLU ProBiology · higher is betterTest setup not documented as identicalGPT-5.4: 92.9%Gemini 3.5 Flash-Lite: 91.9%Vals AIAs of 09/01/2026
MortgageTaxNumerical Extraction · higher is betterTest setup not documented as identicalGPT-5.4: 76.0%Gemini 3.5 Flash-Lite: 75.8%Vals AIAs of 09/01/2026
ProgramBenchAlmost Resolved · higher is betterTest setup not documented as identicalGPT-5.4: 7%Gemini 3.5 Flash-Lite: 0%Vals AIAs of 11/05/2026
SWE-bench Verified<15 min fix · higher is betterTest setup not documented as identicalGPT-5.4: 88.1%Gemini 3.5 Flash-Lite: 85.6%Vals AIAs of 09/01/2026
TaxEval v2Correctness · higher is betterTest setup not documented as identicalGPT-5.4: 64.9%Gemini 3.5 Flash-Lite: 61.7%Vals AIAs of 09/01/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalGPT-5.4: 68.6%Gemini 3.5 Flash-Lite: 7.0%Vals AIAs of 10/29/2026
CorpFin v2Max Fitting Context · higher is betterTest setup not documented as identicalGPT-5.4: 64.9%Gemini 3.5 Flash-Lite: 62.4%Vals AIAs of 08/12/2026
GPQA DiamondZero-Shot CoT · higher is betterTest setup not documented as identicalGPT-5.4: 91.9%Gemini 3.5 Flash-Lite: 85.9%Vals AIAs of 09/01/2026
LegalBenchInterpretation Tasks · higher is betterTest setup not documented as identicalGPT-5.4: 83.9%Gemini 3.5 Flash-Lite: 80.3%Vals AIAs of 10/13/2026
LiveCodeBenchHard · higher is betterTest setup not documented as identicalGPT-5.4: 67.7%Gemini 3.5 Flash-Lite: 53.4%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevReact development · higher is betterGPT-5.4: 1,388Gemini 3.5 Flash-Lite: 1,407LMArenaAs of 11/15/2026
LMArena Text, Style ControlChinese · higher is betterTest setup not documented as identicalGPT-5.4: 1,505Gemini 3.5 Flash-Lite: 1,485LMArenaAs of 11/11/2026
LMArena Vision, Style ControlCreative writing with images · higher is betterTest setup not documented as identicalGPT-5.4: 1,264Gemini 3.5 Flash-Lite: 1,252LMArenaAs of 11/09/2026
MMLU ProBusiness · higher is betterTest setup not documented as identicalGPT-5.4: 91.8%Gemini 3.5 Flash-Lite: 90.6%Vals AIAs of 09/01/2026
MortgageTaxSemantic Extraction · higher is betterTest setup not documented as identicalGPT-5.4: 60.7%Gemini 3.5 Flash-Lite: 61.5%Vals AIAs of 09/01/2026
ProgramBenchFully Resolved · higher is betterTest setup not documented as identicalGPT-5.4: 0%Gemini 3.5 Flash-Lite: 0%Vals AIAs of 11/05/2026
SWE-bench Verified>4 hours · higher is betterTest setup not documented as identicalGPT-5.4: 0.0%Gemini 3.5 Flash-Lite: 33.3%Vals AIAs of 09/01/2026
TaxEval v2Stepwise Reasoning · higher is betterTest setup not documented as identicalGPT-5.4: 83.0%Gemini 3.5 Flash-Lite: 83.5%Vals AIAs of 09/01/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalGPT-5.4: 3.632 / 5Gemini 3.5 Flash-Lite: 2.652 / 5Vals AIAs of 10/29/2026
CorpFin v2Shared Max Context · higher is betterTest setup not documented as identicalGPT-5.4: 66.8%Gemini 3.5 Flash-Lite: 62.2%Vals AIAs of 08/12/2026
LegalBenchIssue Tasks · higher is betterTest setup not documented as identicalGPT-5.4: 90.5%Gemini 3.5 Flash-Lite: 89.3%Vals AIAs of 10/13/2026
LiveCodeBenchMedium · higher is betterTest setup not documented as identicalGPT-5.4: 85.6%Gemini 3.5 Flash-Lite: 84.9%Vals AIAs of 09/01/2026
LMArena Code Arena WebDevWeb development · higher is betterGPT-5.4: 1,400Gemini 3.5 Flash-Lite: 1,432LMArenaAs of 11/15/2026
LMArena Text, Style ControlCoding · higher is betterTest setup not documented as identicalGPT-5.4: 1,521Gemini 3.5 Flash-Lite: 1,502LMArenaAs of 11/11/2026
LMArena Vision, Style ControlDiagram understanding · higher is betterTest setup not documented as identicalGPT-5.4: 1,319Gemini 3.5 Flash-Lite: 1,287LMArenaAs of 11/09/2026
MMLU ProChemistry · higher is betterTest setup not documented as identicalGPT-5.4: 91.1%Gemini 3.5 Flash-Lite: 91.0%Vals AIAs of 09/01/2026
ProgramBenchRaw Pass Rate · higher is betterTest setup not documented as identicalGPT-5.4: 68.6%Gemini 3.5 Flash-Lite: 33.9%Vals AIAs of 11/05/2026
SWE-bench Verified1-4 hours · higher is betterTest setup not documented as identicalGPT-5.4: 50.0%Gemini 3.5 Flash-Lite: 40.5%Vals AIAs of 09/01/2026
LegalBenchRhetoric Tasks · higher is betterTest setup not documented as identicalGPT-5.4: 82.8%Gemini 3.5 Flash-Lite: 80.6%Vals AIAs of 10/13/2026
LMArena Text, Style ControlCreative writing · higher is betterTest setup not documented as identicalGPT-5.4: 1,440Gemini 3.5 Flash-Lite: 1,436LMArenaAs of 11/11/2026
LMArena Vision, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.4: 1,279Gemini 3.5 Flash-Lite: 1,266LMArenaAs of 11/09/2026
MMLU ProComputer Science · higher is betterTest setup not documented as identicalGPT-5.4: 89.8%Gemini 3.5 Flash-Lite: 87.6%Vals AIAs of 09/01/2026
SWE-bench Verified15 min - 1 hour · higher is betterTest setup not documented as identicalGPT-5.4: 76.2%Gemini 3.5 Flash-Lite: 73.2%Vals AIAs of 09/01/2026
LegalBenchRule Tasks · higher is betterTest setup not documented as identicalGPT-5.4: 84.0%Gemini 3.5 Flash-Lite: 81.7%Vals AIAs of 10/13/2026
LMArena Text, Style ControlEnglish · higher is betterTest setup not documented as identicalGPT-5.4: 1,476Gemini 3.5 Flash-Lite: 1,461LMArenaAs of 11/11/2026
LMArena Vision, Style ControlHomework · higher is betterTest setup not documented as identicalGPT-5.4: 1,330Gemini 3.5 Flash-Lite: 1,288LMArenaAs of 11/09/2026
MMLU ProEconomics · higher is betterTest setup not documented as identicalGPT-5.4: 89.7%Gemini 3.5 Flash-Lite: 89.8%Vals AIAs of 09/01/2026
LMArena Text, Style ControlEntertainment, sports and media · higher is betterTest setup not documented as identicalGPT-5.4: 1,441Gemini 3.5 Flash-Lite: 1,433LMArenaAs of 11/11/2026
LMArena Vision, Style ControlHumor · higher is betterTest setup not documented as identicalGPT-5.4: 1,267Gemini 3.5 Flash-Lite: 1,267LMArenaAs of 11/09/2026

More comparisons

Compare GPT-5.4 and Gemini 3.5 Flash-Lite with the models people compare them with most often.

Compare another matchup

The most popular comparisons

  1. 1Gemini 3.8 Flash vs. Gemini 3.5 Flash-Lite
  2. 2GPT-6 Luna vs. Gemini 3.5 Flash-Lite
  3. 3Claude Haiku 5.5 vs. Gemini 3.5 Flash-Lite
  4. 4GPT-6 Luna vs. GPT-5.4
  5. 5Claude Sonnet 5.5 vs. Gemini 3.5 Flash-Lite
  6. 6GPT-5.4 vs. GLM-5.3-Flash
  7. 7Gemini 3.5 Flash-Lite vs. Qwen 3.8 27B
  8. 8Gemini 3.5 Flash-Lite vs. DeepSeek-V4.1-Flash
  9. 9GPT-6 Sol vs. GPT-5.4
Show all 27 comparisons
  1. 10GPT-5.6 Luna vs. Gemini 3.5 Flash-Lite
  2. 11Gemini 3.5 Flash-Lite vs. DeepSeek V4.1 Flash 1017
  3. 12Gemini 3.5 Flash-Lite vs. GLM-5.3
  4. 13Claude Opus 5.5 vs. Gemini 3.5 Flash-Lite
  5. 14Gemini 3.7 Flash vs. Gemini 3.5 Flash-Lite
  6. 15GPT-5.6 Luna vs. GPT-5.4
  7. 16GPT-5.4 vs. GLM-5.3
  8. 17Claude Sonnet 5.5 vs. GPT-5.4
  9. 18GPT-6 Astra vs. GPT-5.4
  10. 19Claude Opus 5.5 vs. GPT-5.4
  11. 20GPT-5.6 Terra vs. GPT-5.4
  12. 21GPT-5.6 Sol vs. GPT-5.4
  13. 22Claude Haiku 4.5 vs. Gemini 3.5 Flash-Lite
  14. 23Claude Fable 5 vs. GPT-5.4
  15. 24GPT-6.1 Sol vs. GPT-5.4
  16. 25Gemini 4 Argon vs. Gemini 3.5 Flash-Lite
  17. 26GPT-6.1 Terra vs. GPT-5.4
  18. 27Gemini 4 Carbon vs. Gemini 3.5 Flash-Lite