GPT-5.6 Solvs.Kimi K3.1 Pro
Which one is better?
Kimi K3.1 Pro is clearly ahead in the overall index and is cheaper too: GPT-5.6 Sol costs twice as much per token.
71
GPT-5.6 Sol
Rank 12 to 18
80
Kimi K3.1 Pro
Rank 10 to 13
84
GPT-5.6 Sol
fairly slow
36
Kimi K3.1 Pro
slow
$8
GPT-5.6 Sol
expensive
$4
Kimi K3.1 Pro
fairly expensive
GPT-5.6 Sol
- Subscription
At OpenAI from €23 a month (ChatGPT Plus). Through other providers from ≈ €6.36 a month (ElevenLabs Starter, with limited credits). 56 plans in Germany.
- Via API
$4 input, $20 output per 1M tokens, cheaper since Sep 25, 2026 (before $4.40 and $22).
- Note
- There is a successor: GPT-6 Astra (rank 4 to 8, $10 input, $50 output).
Kimi K3.1 Pro
- Subscription
At Moonshot AI from ≈ €20.14 a month (Kimi Plus, with limited credits). 4 plans in Germany.
- Via API
$2 input, $10 output per 1M tokens.
Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT
Where is the difference?
Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.
GPT-5.6 Sol ahead: 0Kimi K3.1 Pro ahead: 2level: 6too little data: 2of 10 areas
AreaGPT-5.6 SolKimi K3.1 Pro0 to 100, higher is betterResult
Areas in the overall index
CodinglevelGPT-5.6 Sol: 80Kimi K3.1 Pro: 85
ReasoninglevelGPT-5.6 Sol: 84Kimi K3.1 Pro: 80
MathematicsKimi K3.1 Pro aheadGPT-5.6 Sol: 71Kimi K3.1 Pro: 81
KnowledgeKimi K3.1 Pro aheadGPT-5.6 Sol: 62Kimi K3.1 Pro: 85
AgentslevelGPT-5.6 Sol: 64Kimi K3.1 Pro: 80
GenerallevelGPT-5.6 Sol: 76Kimi K3.1 Pro: 74
Multimodaltoo little dataGPT-5.6 Sol: 74Kimi K3.1 Pro: 75
Specialist fields
FinancelevelGPT-5.6 Sol: 56Kimi K3.1 Pro: 62
LegallevelGPT-5.6 Sol: 64Kimi K3.1 Pro: 68
Healthonly GPT-5.6 Sol has a scoreGPT-5.6 Sol: 51Kimi K3.1 Pro: not enough data
Show 3 more areas that do not count toward the overall index
AreaGPT-5.6 SolKimi K3.1 Pro0 to 100, higher is betterResult
Cybersecurityonly GPT-5.6 Sol has a scoreGPT-5.6 Sol: 88Kimi K3.1 Pro: not enough data
Searchonly GPT-5.6 Sol has a scoreGPT-5.6 Sol: 97Kimi K3.1 Pro: not enough data
Productivityonly GPT-5.6 Sol has a scoreGPT-5.6 Sol: 71Kimi K3.1 Pro: not enough data
See for yourself: same task, one attempt
The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.
Pelican on a bicycle
A community classic for free-form SVG drawing.
GPT-5.6 Sol
Reasoning (requested): high
Current attempt
- Run date
- Oct 1, 2026
- API provider
- openrouter
- Requested API model
- openai/gpt-5.6-sol
- API model reported in response
- openai/gpt-5.6-sol
- Reasoning setting
- high
- Pinned endpoint
- OpenAI | openai/gpt-5.6-sol-20260709
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Test protocol
- community-visual-tests-v1
- Technical checks
- Passed, not a quality rating
- Response time
- 58.7 s
Visually reviewed. This individual test does not establish overall model quality.
Earlier attempts (1)
- Sep 7, 2026API request failedReasoning setting: high
Kimi K3.1 Pro
Not tested yet
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)SVG short test
There is no shared test round for this selection. Results from different rounds are not mixed.
All data side by side
The better value is bold. For the overall index only when the gap is clear.
| Metric | GPT-5.6 Sol | Kimi K3.1 Pro |
|---|---|---|
| Intelligence | ||
| Overall index0 to 100, higher is better | 71 | 80 |
| Rank | Rank 12 to 18 of 95 | Rank 10 to 13 of 95 |
| Price per 1M tokens | ||
| Inputwhat you send | $4above 272,000 tokens: $8 | $2 |
| Outputwhat the model writes | $20above 272,000 tokens: $30 | $10 |
| Speed | ||
| Tokens per second | 84 | 36 |
| Technical | ||
| Context windowhow much text the model reads at once | 1.05 M tokens≈ 1,580 A4 pages | 1.05 M tokens≈ 1,570 A4 pages |
| Knowledge cutoff | Feb 16, 2026 | n/a |
| Released | Jul 9, 2026 | Oct 23, 2026 |
| Availability | Active | Active |
| Open weights | no | n/a |
- Kimi K3.1 Pro, API price listed by Artificial Analysis: $2 input, $10 output, and $0.20 cached input per 1 million tokens. Kimi's official API publishes CNY rates separately. Source
- Kimi K3.1 Pro, Official API pricing: K3.1 Pro: CNY 13 input, CNY 68 output, CNY 13 cache write, and CNY 1.30 cache hit per million tokens. Source
- Kimi K3.1 Pro, Highspeed API pricing: CNY 26 input, CNY 136 output, CNY 26 cache write, and CNY 1.30 cache hit per million tokens. Source
- Kimi K3.1 Pro, International API pricing in USD: The international Kimi platform lists $2 input, $10 output, $2 cache write and $0.20 cache hit per million tokens. Highspeed costs $4/$20/$4/$0.20. Checked October 29, 2026. Separately documented CNY tariffs remain separate observations. Source
Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis
Shared benchmarks
Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.
A: GPT-5.6 SolB: Kimi K3.1 Pro
BioMysteryBenchOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 71.1%Kimi K3.1 Pro: 75.6%Vals AIAs of 10/24/2026
IOIOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 91.2%Kimi K3.1 Pro: 81.9%Vals AIAs of 10/24/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 48.1%Kimi K3.1 Pro: 37.5%Vals AIAs of 10/26/2026
MysteryMechanismOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 33.3%Kimi K3.1 Pro: 26.1%Vals AIAs of 10/24/2026
ProofBench v1.1Overall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 83%Kimi K3.1 Pro: 91%Vals AIAs of 10/24/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 31.1%Kimi K3.1 Pro: 24.9%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Overall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 37.9%Kimi K3.1 Pro: 63.6%Vals AIAs of 10/26/2026
Terminal-Bench-ScienceOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 20%Kimi K3.1 Pro: 31.4%Vals AIAs of 10/25/2026
Vals Science IndexOverall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 41.5%Kimi K3.1 Pro: 44.4%Vals AIAs of 10/25/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 80.5%Kimi K3.1 Pro: 84.9%Vals AIAs of 10/26/2026
Show 50 more benchmarks
BioMysteryBenchHard · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 29.4%Kimi K3.1 Pro: 29.4%Vals AIAs of 10/24/2026
IOIIOI 2024 · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 100%Kimi K3.1 Pro: 100%Vals AIAs of 10/24/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 60.6%Kimi K3.1 Pro: 56.1%Vals AIAs of 10/26/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 20%Kimi K3.1 Pro: 10%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Hardware · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 0%Kimi K3.1 Pro: 40%Vals AIAs of 10/26/2026
Terminal-Bench-ScienceEarth Sciences · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 25%Kimi K3.1 Pro: 12.5%Vals AIAs of 10/25/2026
Vals Science IndexBioMysteryBench · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 71.1%Kimi K3.1 Pro: 75.6%Vals AIAs of 10/25/2026
BioMysteryBenchHuman-solvable · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 80.8%Kimi K3.1 Pro: 86.3%Vals AIAs of 10/24/2026
IOIIOI 2025 · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 88.3%Kimi K3.1 Pro: 75.5%Vals AIAs of 10/24/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 90.7%Kimi K3.1 Pro: 81.9%Vals AIAs of 10/26/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 68.5%Kimi K3.1 Pro: 58%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Media · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 25%Kimi K3.1 Pro: 58.3%Vals AIAs of 10/26/2026
Terminal-Bench-ScienceEngineering Sciences · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 11.1%Kimi K3.1 Pro: 22.2%Vals AIAs of 10/25/2026
Vals Science IndexMysteryMechanism · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 33.3%Kimi K3.1 Pro: 26.1%Vals AIAs of 10/25/2026
IOIIOI 2026 · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 85.2%Kimi K3.1 Pro: 70.2%Vals AIAs of 10/24/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 53.5%Kimi K3.1 Pro: 27.9%Vals AIAs of 10/26/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 50%Kimi K3.1 Pro: 36.7%Vals AIAs of 10/26/2026
Terminal-Bench 4.0ML · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 42.4%Kimi K3.1 Pro: 81.8%Vals AIAs of 10/26/2026
Terminal-Bench-ScienceLife Sciences · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 21.1%Kimi K3.1 Pro: 36.8%Vals AIAs of 10/25/2026
Vals Science IndexTerminal-Bench-Science · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 20%Kimi K3.1 Pro: 31.4%Vals AIAs of 10/25/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 89%Kimi K3.1 Pro: 66.3%Vals AIAs of 10/26/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 74.4%Kimi K3.1 Pro: 64.8%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Operations · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 25.9%Kimi K3.1 Pro: 55.6%Vals AIAs of 10/26/2026
Terminal-Bench-ScienceMathematical Sciences · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 11.8%Kimi K3.1 Pro: 23.5%Vals AIAs of 10/25/2026
Legal Research BenchCivil Litigation · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 40.7%Kimi K3.1 Pro: 29.6%Vals AIAs of 10/26/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 23.3%Kimi K3.1 Pro: 27.9%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Science · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 42.9%Kimi K3.1 Pro: 73.8%Vals AIAs of 10/26/2026
Terminal-Bench-SciencePhysical Sciences · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 29.4%Kimi K3.1 Pro: 47.1%Vals AIAs of 10/25/2026
Legal Research BenchCivil Litigation · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 90.2%Kimi K3.1 Pro: 75.8%Vals AIAs of 10/26/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 60.4%Kimi K3.1 Pro: 68.8%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Security · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 53.3%Kimi K3.1 Pro: 73.3%Vals AIAs of 10/26/2026
Legal Research BenchConstitutional / Civil Rights · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 34.2%Kimi K3.1 Pro: 31.6%Vals AIAs of 10/26/2026
Tax Agent BenchForms & Filings · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 20%Kimi K3.1 Pro: 13.3%Vals AIAs of 10/26/2026
Terminal-Bench 4.0Software · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 46.3%Kimi K3.1 Pro: 53.7%Vals AIAs of 10/26/2026
Legal Research BenchConstitutional / Civil Rights · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 88.3%Kimi K3.1 Pro: 74.5%Vals AIAs of 10/26/2026
Tax Agent BenchForms & Filings · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 72.5%Kimi K3.1 Pro: 61.9%Vals AIAs of 10/26/2026
Legal Research BenchCriminal · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 43.9%Kimi K3.1 Pro: 28.1%Vals AIAs of 10/26/2026
Tax Agent BenchNumbers & Calculations · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 46.7%Kimi K3.1 Pro: 30%Vals AIAs of 10/26/2026
Legal Research BenchCriminal · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 86.4%Kimi K3.1 Pro: 69.7%Vals AIAs of 10/26/2026
Tax Agent BenchNumbers & Calculations · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 81.4%Kimi K3.1 Pro: 72.9%Vals AIAs of 10/26/2026
Legal Research BenchFamily · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 13.6%Kimi K3.1 Pro: 13.6%Vals AIAs of 10/26/2026
Tax Agent BenchRule & Source Lookup · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 30%Kimi K3.1 Pro: 30%Vals AIAs of 10/26/2026
Legal Research BenchFamily · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 76.7%Kimi K3.1 Pro: 63.6%Vals AIAs of 10/26/2026
Tax Agent BenchRule & Source Lookup · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 53.8%Kimi K3.1 Pro: 53.8%Vals AIAs of 10/26/2026
Legal Research BenchHealth · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 80%Kimi K3.1 Pro: 73.3%Vals AIAs of 10/26/2026
Tax Agent BenchWeighted Pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 68%Kimi K3.1 Pro: 63.7%Vals AIAs of 10/26/2026
Legal Research BenchHealth · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 97.5%Kimi K3.1 Pro: 90.5%Vals AIAs of 10/26/2026
Legal Research BenchImmigration · All-pass · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 45.5%Kimi K3.1 Pro: 18.2%Vals AIAs of 10/26/2026
Legal Research BenchImmigration · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 81.2%Kimi K3.1 Pro: 32.7%Vals AIAs of 10/26/2026
Legal Research BenchOverall · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-5.6 Sol: 87.8%Kimi K3.1 Pro: 71.4%Vals AIAs of 10/26/2026
Compare another matchup
More matchups
Related LLM comparisons
Compare GPT-5.6 Sol and Kimi K3.1 Pro with other leading models.