Gemini 4 Carbonvs.GLM-5.1
Which one is better?
Gemini 4 Carbon is clearly ahead in the overall index.
Gemini 4 Carbon
Rank 1 to 5
GLM-5.1
Rank 48 to 55
Gemini 4 Carbon
fairly fast
GLM-5.1
fairly slow
Gemini 4 Carbon
GLM-5.1
fairly expensive
Gemini 4 Carbon
- Subscription
Subscriptions in Germany: n/a
- Via API
n/a (no API price known).
GLM-5.1
- Subscription
No Z.ai subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 13 plans in Germany.
- Via API
$1.40 input, $4.40 output per 1M tokens according to the provider; the price index has listed it at $1.05 and $3.50 since Sep 3, 2026.
Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT
Where is the difference?
Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.
Gemini 4 Carbon ahead: 6GLM-5.1 ahead: 0level: 0too little data: 2of 8 areas
Show 1 more areas that do not count toward the overall index
See for yourself: same task, one attempt
The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.
Pelican on a bicycle
A community classic for free-form SVG drawing.
Gemini 4 Carbon
Not tested yet
GLM-5.1
Output withheld for safety
Reasoning (requested): high
Current attempt
- Run date
- Oct 5, 2026
- API provider
- openrouter
- Requested API model
- z-ai/glm-5.1
- API model reported in response
- z-ai/glm-5.1
- Reasoning setting
- high
- Pinned endpoint
- Z.AI | z-ai/glm-5.1-20260406
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Test protocol
- community-visual-tests-v1
- Technical checks
- Failed
- Response time
- 141.6 s
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Earlier attempts (3)
- Oct 2, 2026Output withheld for safetyReasoning setting: high
- Oct 1, 2026API request failedReasoning setting: high
- Sep 7, 2026API request failedReasoning setting: high
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)SVG short test
There is no shared test round for this selection. Results from different rounds are not mixed.
All data side by side
The better value is bold. For the overall index only when the gap is clear.
| Metric | Gemini 4 Carbon | GLM-5.1 |
|---|---|---|
| Intelligence | ||
| Overall index0 to 100, higher is better | 96 | 11 |
| Rank | Rank 1 to 5 of 95 | Rank 48 to 55 of 95 |
| Price per 1M tokens | ||
| Inputwhat you send | n/a | $1.40 |
| Outputwhat the model writes | n/a | $4.40 |
| Speed | ||
| Tokens per second | 100 | 77 |
| Technical | ||
| Context windowhow much text the model reads at once | 1 M tokens≈ 1,500 A4 pages | 200,000 tokens≈ 300 A4 pages |
| Knowledge cutoff | n/a | n/a |
| Released | n/a | Apr 7, 2026 |
| Availability | Limited access | Open Source |
| Open weights | no | yes |
- Gemini 4 Carbon, Announced introductory pricing: $2 input and $10 output per 1M tokens. Cached input receives a 95% discount, giving $0.10 per 1M tokens. This announcement does not establish an already available public API. Source
- Gemini 4 Carbon, Announced pricing after the introductory period: Afterward, $4 input and $20 output per 1M tokens. Google has not specified when the introductory period ends. Source
- Gemini 4 Carbon, Artificial Analysis pricing assumptions: Artificial Analysis calculates test costs using $4 input, $20 output, and $0.20 cached input per 1M tokens. These are the evaluator’s pricing assumptions, not confirmation of a publicly available API tariff. Source
Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis
Shared benchmarks
Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.
No directly comparable result yet
No published benchmark for Gemini 4 Carbon and GLM-5.1 currently matches in version, task and metric. We therefore show no estimated or blended values.