Skip to main content

AnthropicGoogleLLM matchup

Claude Haiku 5.5vs.Gemini 3.7 Flash

Which one is better?

Claude Haiku 5.5 and Gemini 3.7 Flash perform about equally well.

level
IntelligenceOverall index, 100 points = average
103.4

Claude Haiku 5.5

Rank 20

107.1

Gemini 3.7 Flash

Rank 16

SpeedTokens per second
236

Claude Haiku 5.5

n/a

Gemini 3.7 Flash

Price$ per 1M tokens
$0.20

Claude Haiku 5.5

n/a

Gemini 3.7 Flash

Haiku 5.5 more popular
Popularity0 to 100
77

Claude Haiku 5.5

Rank 3 of 875

57

Gemini 3.7 Flash

Rank 49 of 875

Above 100,000 tokens of context, Claude Haiku 5.5 costs more: $0.50 input and $2.50 output per 1M tokens.

Choose Claude Haiku 5.5 for

CybersecurityCodingMathematics

Choose Gemini 3.7 Flash for

ReasoningKnowledge (not certain)Legal (not certain)Agents (not certain)

Where is the difference?

Strengths at a glance

Haiku 5.5Gemini 3.7 Flash

The median of all ranked models is below 100 in every area, so it sits in the centre of the net.

105110115120100CodingHaiku 5.5ReasoningGemini 3.7 FlashMathematicsHaiku 5.5Knowledgeslightly Gemini 3.7 FlashAgentsslightly Gemini 3.7 FlashGenerallevelFinancelevelLegalslightly Gemini 3.7 FlashHealthlevel
CodingHaiku 5.5 ahead
Haiku 5.5106.2Rank 18
Gemini 3.7 Flash97.7Rank 33
Median of ranked models83.7

95 % range: Haiku 5.5 102.5 to 109.9, Gemini 3.7 Flash 93.5 to 101.9.

AreaHaiku 5.5Gemini 3.7 Flash

The same values and verdicts as the bars below. In the top field the net starts at 100 points, the reference group average; values below sit as a hollow point in the centre. Not in the net because a model has no own value there or the data are too thin: Multimodal.

Haiku 5.5 is ahead in 2 of 10 areas, Gemini 3.7 Flash in 1.

Haiku 5.5 ahead: 2level: 3too little data: 1Gemini 3.7 Flash slightly ahead: 3Gemini 3.7 Flash ahead: 1

Areas in the overall index
ReasoningGemini 3.7 Flash +11105.2 to 116.0
CodingHaiku 5.5 +9106.2 to 97.7
MathematicsHaiku 5.5 +6107.1 to 100.6
Knowledgeleaning Gemini 3.7 Flashnot certain · 2 tests each
Agentsleaning Gemini 3.7 Flashnot certain · 4 and 3 tests
Generallevel106.4 to 104.2
Multimodalonly Gemini 3.7 Flash has a score
Specialist fields
Legalleaning Gemini 3.7 Flashnot certain · 3 and 2 tests
Healthlevel108.9 to 105.9
Financelevel104.7 to 104.6

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Show 3 more areas that do not count toward the overall index
CybersecurityHaiku 5.5 +12108.6 to 96.9
Productivityonly Haiku 5.5 has a score
Educationonly Haiku 5.5 has a score

Bar length shows the gap in index points (full width 15 points, one standard deviation of the reference group). Solid means clearly ahead, hatched not certain yet, a thin grey bar level.

Which model for which task?

Everyday tasks, translated from the area values above. Each row names the values it rests on.

Writing and debugging codeHaiku 5.5Coding 106.2 to 97.7
Maths and data analysisdepends on the partMathematics 107.1 to 100.6, Reasoning 105.2 to 116.0
Facts and researchleaning Gemini 3.7 FlashKnowledge 85.5 to 110.9
Agents and workflowsleaning Gemini 3.7 FlashAgents 106.1 to 110.8
Security analysisHaiku 5.5Cybersecurity 108.6 to 96.9
Finance, legal and medical textsleaning Gemini 3.7 FlashFinance 104.7 to 104.6, Legal 94.4 to 103.3, Health 108.9 to 105.9
Images, screenshots and PDFsopenMultimodal without a score for Haiku 5.5

See for yourself: same task, one attempt

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Task origin: Simon Willison

Claude Haiku 5.5

Not tested yet

Gemini 3.7 Flash

The response reached the token limit. No complete recording is available.

Oct 5, 2026 · 29 s · $0.03

Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.

Test details
Run date
Oct 5, 2026
API provider
openrouter
Requested API model
google/gemini-3.7-flash
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
8,188 tokens
Cost of the attempt
$0.0307
Response time
28.8 s
API model reported in response
google/gemini-3.7-flash
Pinned endpoint
Google AI Studio | google/gemini-3.7-flash-20260813
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Failed

Earlier attempts (3)

  • Oct 2, 2026API request failedReasoning setting: high
  • Oct 1, 2026API request failedReasoning setting: high
  • Sep 7, 2026API request failedReasoning setting: high
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

Prompt

Return only one standalone SVG of a pelican riding a bicycle. Use viewBox="0 0 800 600", simple shapes, two clearly visible wheels and a recognizable pelican with a long beak. At most 30 SVG elements and 1800 characters. No Markdown, explanations, comments, scripts, animation, CSS or external resources.

Claude Haiku 5.5

Unavailable in this round

Gemini 3.7 Flash

Unavailable in this round

Claude Haiku 5.5 and Gemini 3.7 Flash in the overall index

Every model with a place in the overall index, both models of this matchup highlighted. You can add or hide other models.

Overall index (Gradually Meta-Score v4)

20 of 91 models

4 models in this view are measured at a lower reasoning effort than max in the overall index. Dashed column: lower reasoning effort than the top.

Claude Opus 5.5max126.1
Gemini 4 Carbonhigh125.7
Claude Fable 5.1max123.8
Claude Sonnet 5.5max122.8
Gemini 4 Argonhigh122.3
GPT-6 Astramax121.3
GPT-6.1 Solmax119.2
Muse Wonder Fullmax118.3
Claude Opus 5max117.2
Muse Wondermax113.4
Kimi K3.1 Promax112.9
Claude Fable 5max112.5
GPT-6 Solmax110.6
GPT-5.6 Solmax108.7
Muse Spark 1.3max107.4
Gemini 3.7 Flashhigh107.1
DeepSeek V4.1 Flash 1017max106.6
Gemini 3.8 Flashhigh106.5
GPT-6.1 Terramax105.2
Claude Haiku 5.5max103.4

Popularity compared

How often the models are searched for, used and mentioned, on a scale from 0 to 100.

Claude Haiku 5.5 is more popular than Gemini 3.7 Flash: 77 to 57 out of 100.

Over time

Weekly values from October 18, 2026 to November 5, 2026

Claude Haiku 5.5Gemini 3.7 Flash

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricClaude Haiku 5.5Gemini 3.7 Flash
Intelligence
Overall indexpoints, 100 = reference group average, higher is better103.4107.1
RankRank 20 of 91Rank 16 of 91
Price per 1M tokens
Inputwhat you send$0.10above 100,000 tokens: $0.50n/a
Outputwhat the model writes$0.50above 100,000 tokens: $2.50n/a
Speed
Tokens per second236n/a
Popularity
Popularitysearch, usage and mentions, 0 to 10077Rank 3 of 87557Rank 49 of 875
Technical
Context windowhow much text the model reads at once1 M tokens≈ 1,500 A4 pages1.05 M tokens≈ 1,570 A4 pages
Knowledge cutoffJune 2026March 2026
ReleasedOct 7, 2026Aug 13, 2026
AvailabilityActiveDiscontinued
Open weightsnono

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Is there a better choice?

Successor of Gemini 3.7 FlashGemini 3.8 Flash

Overall index 106.5, rank 18. $0.75 input and $3.75 output per 1M tokens.

Haiku 5.5 vs. Gemini 3.8 Flash
Best model in the overall indexClaude Opus 5.5

Overall index 126.1, rank 1. $4 input and $20 output per 1M tokens.

Gemini 3.7 Flash vs. Claude Opus 5.5

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: Claude Haiku 5.5B: Gemini 3.7 Flash

Code MigrationOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 44.6%Gemini 3.7 Flash: 34.8%Vals AIAs of 10/29/2026
CyberBench v1.1Overall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 75.5%Gemini 3.7 Flash: 43.8%Vals AIAs of 11/05/2026
EMBOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 59%Gemini 3.7 Flash: 71.3%Vals AIAs of 10/20/2026
Finance Agent (v2)Overall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 54.1%Gemini 3.7 Flash: 59%Vals AIAs of 10/29/2026
GDPval-AAOverall · higher is betterClaude Haiku 5.5: 1,424.29 eloGemini 3.7 Flash: 1,402.91 eloArtificial AnalysisAs of 11/06/2026
IOIOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 47.3%Gemini 3.7 Flash: 67.8%Vals AIAs of 10/29/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 43.8%Gemini 3.7 Flash: 34.6%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevOverall · higher is betterClaude Haiku 5.5: 1,589Gemini 3.7 Flash: 1,590LMArenaAs of 10/28/2026
LMArena Text, Style ControlOverall · higher is betterClaude Haiku 5.5: 1,425Gemini 3.7 Flash: 1,490LMArenaAs of 10/28/2026
MedCodeOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 51.5%Gemini 3.7 Flash: 53.4%Vals AIAs of 10/29/2026
Show 54 more benchmarks
MedScribeOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 89.5%Gemini 3.7 Flash: 83.9%Vals AIAs of 10/29/2026
ProgramBenchOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 2.5%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026
ProofBench v1.1Overall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 89%Gemini 3.7 Flash: 58%Vals AIAs of 10/29/2026
SRE BenchOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 5.7%Gemini 3.7 Flash: 4.6%Vals AIAs of 11/05/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 31.9%Gemini 3.7 Flash: 22.8%Vals AIAs of 11/05/2026
Terminal-Bench 4.0Overall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 36.4%Gemini 3.7 Flash: 12.1%Vals AIAs of 11/05/2026
Terminal-Bench-ScienceOverall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 10%Gemini 3.7 Flash: 7.1%Vals AIAs of 11/05/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 90.4%Gemini 3.7 Flash: 70.4%Vals AIAs of 11/05/2026
Code MigrationCLI · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 36.1%Gemini 3.7 Flash: 23.5%Vals AIAs of 10/29/2026
CyberBench v1.1Patch · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 89.3%Gemini 3.7 Flash: 87.5%Vals AIAs of 11/05/2026
EMBComps · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 77.9%Gemini 3.7 Flash: 74.6%Vals AIAs of 10/20/2026
Finance Agent (v2)Adjustments · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 49.6%Gemini 3.7 Flash: 54.7%Vals AIAs of 10/29/2026
GDPval-AAOverall · higher is betterClaude Haiku 5.5: 1,130.36 eloGemini 3.7 Flash: 1,327.19 eloArtificial AnalysisAs of 11/06/2026
IOIIOI 2024 · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 67.7%Gemini 3.7 Flash: 72.8%Vals AIAs of 10/29/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 50%Gemini 3.7 Flash: 42.4%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevHTML development · higher is betterClaude Haiku 5.5: 1,568Gemini 3.7 Flash: 1,591LMArenaAs of 10/28/2026
LMArena Text, Style ControlBusiness, management and finance · higher is betterClaude Haiku 5.5: 1,435Gemini 3.7 Flash: 1,485LMArenaAs of 10/28/2026
ProgramBenchAlmost Resolved · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 29.5%Gemini 3.7 Flash: 9.5%Vals AIAs of 11/05/2026
SRE BenchCapability Score · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 18.1%Gemini 3.7 Flash: 14.2%Vals AIAs of 11/05/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 6.7%Gemini 3.7 Flash: 6.7%Vals AIAs of 11/05/2026
Terminal-Bench 4.0Hardware · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 20%Gemini 3.7 Flash: 13.3%Vals AIAs of 11/05/2026
Terminal-Bench-ScienceEarth Sciences · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 0%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026
Code MigrationCOBOL · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 70%Gemini 3.7 Flash: 68.6%Vals AIAs of 10/29/2026
CyberBench v1.1PoC · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 61.7%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026
EMBDataroom · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 85.5%Gemini 3.7 Flash: 86.5%Vals AIAs of 10/20/2026
Finance Agent (v2)All-Pass · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 42.9%Gemini 3.7 Flash: 47.5%Vals AIAs of 10/29/2026
GDPval-AAOverall · higher is betterClaude Haiku 5.5: 1,282.5 eloGemini 3.7 Flash: 1,366.98 eloArtificial AnalysisAs of 11/06/2026
IOIIOI 2025 · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 31.3%Gemini 3.7 Flash: 69.8%Vals AIAs of 10/29/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 88.7%Gemini 3.7 Flash: 85.1%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevReact development · higher is betterClaude Haiku 5.5: 1,608Gemini 3.7 Flash: 1,586LMArenaAs of 10/28/2026
LMArena Text, Style ControlChinese · higher is betterClaude Haiku 5.5: 1,468Gemini 3.7 Flash: 1,547LMArenaAs of 10/28/2026
ProgramBenchFully Resolved · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 2.5%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026
SRE BenchFully Solved · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 5.7%Gemini 3.7 Flash: 4.6%Vals AIAs of 11/05/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 54.1%Gemini 3.7 Flash: 46%Vals AIAs of 11/05/2026
Terminal-Bench 4.0Media · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 25%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026
Terminal-Bench-ScienceEngineering Sciences · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 0%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026
Code MigrationCode Quality · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 4.825 / 5Gemini 3.7 Flash: 3.664 / 5Vals AIAs of 10/29/2026
EMBDCF · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 55.1%Gemini 3.7 Flash: 66.1%Vals AIAs of 10/20/2026
Finance Agent (v2)Comparables · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 45.3%Gemini 3.7 Flash: 50.3%Vals AIAs of 10/29/2026
IOIIOI 2026 · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 42.8%Gemini 3.7 Flash: 60.8%Vals AIAs of 10/29/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 44.2%Gemini 3.7 Flash: 37.2%Vals AIAs of 11/05/2026
LMArena Code Arena WebDevWeb development · higher is betterClaude Haiku 5.5: 1,589Gemini 3.7 Flash: 1,590LMArenaAs of 10/28/2026
LMArena Text, Style ControlCoding · higher is betterClaude Haiku 5.5: 1,489Gemini 3.7 Flash: 1,520LMArenaAs of 10/28/2026
ProgramBenchRaw Pass Rate · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 78.7%Gemini 3.7 Flash: 68.7%Vals AIAs of 11/05/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 36.7%Gemini 3.7 Flash: 30%Vals AIAs of 11/05/2026
Terminal-Bench 4.0ML · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 63.6%Gemini 3.7 Flash: 12.1%Vals AIAs of 11/05/2026
Terminal-Bench-ScienceLife Sciences · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 15.8%Gemini 3.7 Flash: 10.5%Vals AIAs of 11/05/2026
EMBLBO · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 28.2%Gemini 3.7 Flash: 59.4%Vals AIAs of 10/20/2026
Finance Agent (v2)Disclosure Analysis · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 64.3%Gemini 3.7 Flash: 67.7%Vals AIAs of 10/29/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 87%Gemini 3.7 Flash: 89.5%Vals AIAs of 11/05/2026
LMArena Text, Style ControlCreative writing · higher is betterClaude Haiku 5.5: 1,361Gemini 3.7 Flash: 1,490LMArenaAs of 10/28/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 56.2%Gemini 3.7 Flash: 68.8%Vals AIAs of 11/05/2026
Terminal-Bench 4.0Operations · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 18.5%Gemini 3.7 Flash: 14.8%Vals AIAs of 11/05/2026
Terminal-Bench-ScienceMathematical Sciences · higher is betterTest setup not documented as identicalClaude Haiku 5.5: 11.8%Gemini 3.7 Flash: 0%Vals AIAs of 11/05/2026

More comparisons

Compare Claude Haiku 5.5 and Gemini 3.7 Flash with the models people compare them with most often.

Compare another matchup

The most popular comparisons

  1. 1Claude Haiku 5.5 vs. GPT-6 Luna
  2. 2Claude Sonnet 5.5 vs. Claude Haiku 5.5
  3. 3Claude Haiku 5.5 vs. DeepSeek V4.1 Flash 1017
  4. 4Claude Haiku 5.5 vs. DeepSeek-V4-Flash
  5. 5Claude Haiku 5.5 vs. DeepSeek-V4.1-Flash
  6. 6Claude Opus 5.5 vs. Claude Haiku 5.5
  7. 7Claude Haiku 5.5 vs. GLM-5.3
  8. 8Claude Haiku 5.5 vs. Gemini 3.5 Flash-Lite
  9. 9Claude Haiku 5.5 vs. Gemini 3.8 Flash
Show all 41 comparisons
  1. 10Claude Haiku 5.5 vs. Claude Sonnet 4.5
  2. 11Claude Haiku 5.5 vs. Claude Sonnet 5
  3. 12Claude Haiku 5.5 vs. Claude Opus 5
  4. 13Claude Haiku 5.5 vs. GPT-6 Astra
  5. 14Claude Haiku 5.5 vs. Gemini 3.5 Flash
  6. 15Claude Haiku 5.5 vs. Claude Opus 4.8
  7. 16Claude Haiku 5.5 vs. Gemini 4 Argon
  8. 17Claude Haiku 5.5 vs. Grok 4.7
  9. 18Claude Haiku 5.5 vs. GPT-5.6 Luna
  10. 19Claude Haiku 5.5 vs. Qwen 3.8 Max 0902
  11. 20Claude Haiku 5.5 vs. Muse Spark 1.3
  12. 21Gemini 3.7 Flash vs. Qwen 3.8 Max 0902
  13. 22Claude Haiku 5.5 vs. Claude Sonnet 4.6
  14. 23Claude Haiku 5.5 vs. Mistral Large 4
  15. 24Claude Haiku 5.5 vs. GPT-6.1 Sol
  16. 25GPT-5.6 Luna vs. Gemini 3.7 Flash
  17. 26GPT-6 Luna vs. Gemini 3.7 Flash
  18. 27Claude Haiku 5.5 vs. Gemini 3.1 Pro Preview
  19. 28Claude Haiku 5.5 vs. GLM-5.3-Flash
  20. 29Claude Haiku 5.5 vs. DeepSeek-V4-Pro
  21. 30Claude Haiku 5.5 vs. GPT-5.6 Sol
  22. 31Claude Haiku 5.5 vs. Gemini 3.6 Flash
  23. 32Claude Sonnet 5.5 vs. Gemini 3.7 Flash
  24. 33Claude Haiku 5.5 vs. Claude Opus 4.6
  25. 34Claude Haiku 5.5 vs. Kimi K2.6
  26. 35Gemini 3.7 Flash vs. DeepSeek-V4-Pro
  27. 36Gemini 3.7 Flash vs. Gemini 3.1 Pro Preview
  28. 37Claude Haiku 5.5 vs. Claude Opus 4.7
  29. 38Claude Haiku 5.5 vs. Mistral Large 3
  30. 39Gemini 3.7 Flash vs. Gemini 3.5 Flash-Lite
  31. 40Claude Haiku 5.5 vs. GPT-5.5
  32. 41Claude Haiku 5.5 vs. GPT-6.1 Terra