Skip to main content

GPT-6.1 Solvs.Gemini 4 Carbon

Which one is better?

Gemini 4 Carbon is clearly ahead in the overall index.

IntelligenceOverall index, 0 to 100 · higher is better
90

GPT-6.1 Sol

Rank 6 to 9

96

Gemini 4 Carbon

Rank 1 to 5

SpeedTokens per second · higher is better
79

GPT-6.1 Sol

fairly slow

100

Gemini 4 Carbon

fairly fast

PriceDollars per 1M tokens · lower is better
$4

GPT-6.1 Sol

fairly expensive

n/a

Gemini 4 Carbon

GPT-6.1 Sol

Subscription

At OpenAI from €23 a month (ChatGPT Plus). Through other providers from ≈ €6.36 a month (ElevenLabs Starter, with limited credits). 58 plans in Germany.

Via API

$2 input, $10 output per 1M tokens.

Gemini 4 Carbon

Subscription

Subscriptions in Germany: n/a

Via API

n/a (no API price known).

Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT

Where is the difference?

Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.

GPT-6.1 Sol ahead: 0Gemini 4 Carbon ahead: 4level: 2too little data: 4of 10 areas

GPT-6.1 SolGemini 4 Carbon0 to 100, higher is better
Areas in the overall index
CodinglevelGPT-6.1 Sol: 91Gemini 4 Carbon: 92
ReasoninglevelGPT-6.1 Sol: 95Gemini 4 Carbon: 96
Mathematicsonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 95Gemini 4 Carbon: not enough data
KnowledgeGemini 4 Carbon aheadGPT-6.1 Sol: 95Gemini 4 Carbon: above 99
AgentsGemini 4 Carbon aheadGPT-6.1 Sol: 77Gemini 4 Carbon: 88
Generalonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 94Gemini 4 Carbon: not enough data
Multimodalonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 88Gemini 4 Carbon: not enough data
Specialist fields
FinanceGemini 4 Carbon aheadGPT-6.1 Sol: 65Gemini 4 Carbon: 94
LegalGemini 4 Carbon aheadGPT-6.1 Sol: 68Gemini 4 Carbon: 94
Healthonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 75Gemini 4 Carbon: not enough data
Show 4 more areas that do not count toward the overall index
GPT-6.1 SolGemini 4 Carbon0 to 100, higher is better
Cybersecurityonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 47Gemini 4 Carbon: not enough data
Searchonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 92Gemini 4 Carbon: not enough data
Productivityonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 51Gemini 4 Carbon: not enough data
Educationonly GPT-6.1 Sol has a scoreGPT-6.1 Sol: 92Gemini 4 Carbon: not enough data

See for yourself: same task, one attempt

The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.

Pelican on a bicycle

A community classic for free-form SVG drawing.

GPT-6.1 Sol

GPT-6.1 Sol: Pelican on a bicycle
A community classic for free-form SVG drawing.

Reasoning (requested): high

Current attempt
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
openai/gpt-6.1-sol
API model reported in response
openai/gpt-6.1-sol
Reasoning setting
high
Pinned endpoint
OpenAI | openai/gpt-6.1-sol-20260929
Temperature
Provider default
Token limit including reasoning
8,192 tokens
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating
Response time
83.6 s

Visually reviewed. This individual test does not establish overall model quality.

Gemini 4 Carbon

Not tested yet

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)
SVG short test

There is no shared test round for this selection. Results from different rounds are not mixed.

All data side by side

The better value is bold. For the overall index only when the gap is clear.

MetricGPT-6.1 SolGemini 4 Carbon
Intelligence
Overall index0 to 100, higher is better9096
RankRank 6 to 9 of 95Rank 1 to 5 of 95
Price per 1M tokens
Inputwhat you send$2above 272,000 tokens: $4n/a
Outputwhat the model writes$10above 272,000 tokens: $15n/a
Speed
Tokens per second79100
Technical
Context windowhow much text the model reads at once1.05 M tokens≈ 1,580 A4 pages1 M tokens≈ 1,500 A4 pages
Knowledge cutoffApr 30, 2026n/a
ReleasedSep 29, 2026n/a
AvailabilityActiveLimited access
Open weightsnono
  • Gemini 4 Carbon, Announced introductory pricing: $2 input and $10 output per 1M tokens. Cached input receives a 95% discount, giving $0.10 per 1M tokens. This announcement does not establish an already available public API. Source
  • Gemini 4 Carbon, Announced pricing after the introductory period: Afterward, $4 input and $20 output per 1M tokens. Google has not specified when the introductory period ends. Source
  • Gemini 4 Carbon, Artificial Analysis pricing assumptions: Artificial Analysis calculates test costs using $4 input, $20 output, and $0.20 cached input per 1M tokens. These are the evaluator’s pricing assumptions, not confirmation of a publicly available API tariff. Source

Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis

Shared benchmarks

Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.

A: GPT-6.1 SolB: Gemini 4 Carbon

AA-BriefcaseOverall · higher is betterGPT-6.1 Sol: 1,465.73 eloGemini 4 Carbon: 1,609.49 eloArtificial AnalysisAs of 10/29/2026
AA-OmniscienceOverall · higher is betterGPT-6.1 Sol: 41 pointsGemini 4 Carbon: 53.5 pointsArtificial AnalysisAs of 10/29/2026
AA-Omniscience AccuracyOverall · higher is betterGPT-6.1 Sol: 60.4%Gemini 4 Carbon: 58.3%Artificial AnalysisAs of 10/29/2026
AA-Omniscience Hallucination RateOverall · lower is betterGPT-6.1 Sol: 49.0%Gemini 4 Carbon: 11.4%Artificial AnalysisAs of 10/29/2026
Artificial Analysis Intelligence IndexOverall · higher is betterGPT-6.1 Sol: 50.229 pointsGemini 4 Carbon: 59.426 pointsArtificial AnalysisAs of 10/29/2026
AutomationBench-AAOverall · higher is betterGPT-6.1 Sol: 64.5%Gemini 4 Carbon: 77.8%Artificial AnalysisAs of 10/29/2026
CritPt v2Overall · higher is betterGPT-6.1 Sol: 30.0%Gemini 4 Carbon: 36.0%Artificial AnalysisAs of 10/29/2026
CritPt v2 (Hard Subset)Overall · higher is betterGPT-6.1 Sol: 67.5%Gemini 4 Carbon: 63.0%Artificial AnalysisAs of 10/29/2026
FrontierCodeOverall · higher is betterGPT-6.1 Sol: 36.7%Gemini 4 Carbon: 40.6%Artificial AnalysisAs of 10/29/2026
FrontierCode 1.1 MainOverall · higher is betterGPT-6.1 Sol: 46.6%Gemini 4 Carbon: 48.5%Artificial AnalysisAs of 10/29/2026
Show 14 more benchmarks
GDP.pdfOverall · higher is betterGPT-6.1 Sol: 32.0%Gemini 4 Carbon: 28.4%Artificial AnalysisAs of 10/29/2026
GDPval-AAOverall · higher is betterGPT-6.1 Sol: 1,520.91 eloGemini 4 Carbon: 1,733.07 eloArtificial AnalysisAs of 10/29/2026
HLE-DiamondOverall · higher is betterGPT-6.1 Sol: 51.9%Gemini 4 Carbon: 69.1%Artificial AnalysisAs of 10/29/2026
Terminal-BenchOverall · higher is betterGPT-6.1 Sol: 51.5%Gemini 4 Carbon: 65.2%Artificial AnalysisAs of 10/29/2026
Terminal-Bench-ScienceOverall · higher is betterGPT-6.1 Sol: 46.2%Gemini 4 Carbon: 64.8%Artificial AnalysisAs of 10/29/2026
Vals IndexOverall · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 63.9%Gemini 4 Carbon: 70.4%Vals AIAs of 10/27/2026
Vals IndexCode Migration v1.1 · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 75.1%Gemini 4 Carbon: 80.1%Vals AIAs of 10/27/2026
Vals IndexEMB v1.1 · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 71.1%Gemini 4 Carbon: 76.5%Vals AIAs of 10/27/2026
Vals IndexFinance Agent v2.1 · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 61.8%Gemini 4 Carbon: 67.2%Vals AIAs of 10/27/2026
Vals IndexHLAB-Vals-1.1 · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 6.3%Gemini 4 Carbon: 17.5%Vals AIAs of 10/27/2026
Vals IndexLegal Research · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 38.5%Gemini 4 Carbon: 55.8%Vals AIAs of 10/27/2026
Vals IndexTax Agent · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 21.8%Gemini 4 Carbon: 48.9%Vals AIAs of 10/27/2026
Vals IndexTerminal-Bench 4.0 · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 55.1%Gemini 4 Carbon: 63.1%Vals AIAs of 10/27/2026
Vals IndexVibe Code Bench v1.1 · higher is betterTest setup not documented as identicalGPT-6.1 Sol: 88.9%Gemini 4 Carbon: 89.1%Vals AIAs of 10/27/2026

Compare another matchup