Skip to main content

OpenAILanguage modelActive

GPT-6 Sol

GPT-6 Sol is among the strongest models: Rank 13 of 92 in the overall index. Through the API it is fairly expensive.

IntelligenceRank 13 of 92

110.5Overall indexhigher is better

SpeedRank 33 of 100

111Tokens per secondhigher is better

PriceRank 71 of 95

Input $2 · Output $10

$4per 1M tokenslower is better

ContextRank 2 of 102

1.05Mtokens at once≈ 1,580 A4 pages

PopularityRank 3 of 785

73out of 100+1 vs. last month

based on search, usage and attention

Summary

It is fairly expensive: $4 per 1M tokens (input and output blended); a typical model costs $1.55. At 111 tokens per second it writes faster than a typical model (87).

GPT-6 Sol brings Astra’s training methods to a lower-cost tier. At launch, OpenAI halved standard input and output token prices compared with GPT-5.6 Sol’s promotional rates. Its internal factuality evaluation also found roughly half as many mistakes as with its predecessor. That test deliberately uses difficult conversations where users had previously flagged errors.

GPT-6.1 Sol later improves coding and computer-use results in the same line. GPT-6 Luna launched alongside GPT-6 Sol as the smaller, cheaper tier.

GPT-6 Sol benchmarks

Overall index (Gradually Meta-Score v4)

20 of 92 models

4 models in this view are measured at a lower reasoning effort than max in the overall index. Dashed column: lower reasoning effort than the top.

Speed

20 of 100 models

Mercury 2.5576tokens/s · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Gemini 3.1 Flash-Lite336tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Gemini 3.5 Flash-Lite299tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Nemotron 3.5 Lightning245tokens/s · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Claude Haiku 5.5236tokens/s · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
o3-mini230tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Ling 3.0 Flash199tokens/s · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
DeepSeek-V3 0324195tokens/s · Configuration Non-reasoning · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
GPT-5.4 mini191tokens/s · Configuration Xhigh effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Gemini 3 Flash Preview191tokens/s · Configuration Non-reasoning · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Gemini 3.5 Flash184tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Gemini 3.6 Flash182tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Command A Plus177tokens/s · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
DeepSeek-V4.1-Flash176tokens/s · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
DeepSeek V4.1 Flash 1017172tokens/s · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
Qwen 3.7 Max165tokens/s · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
GPT-5.4 nano153tokens/s · Configuration Xhigh effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
GPT OSS 20B152tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
GPT OSS 120B151tokens/s · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06
GPT-6 Sol111tokens/s · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06

Output tokens per second, measured by Artificial Analysis

Intelligence vs. price

most attractive area: stronger and cheaper than half of the models shownbest intelligence for the price

80100120$0.10$0.50$2$10$20Gemini 3.6 Flash: 96.7, $1.50Step 5 Preview: 97.3, $1.43MiMo V2.6 Flash: 98.3, $0.18Claude Opus 4.8: 99.0, $10DeepSeek-V4.1-Flash: 99.7, $0.26Qwen 3.8 Max 0902: 100.3, $2.48GLM-5.3: 100.7, $2.15GPT-5.6 Terra: 100.7, $4.50MiMo V2.6 Pro: 100.9, $0.54GPT-5.5: 100.9, $11.25Kimi K3: 101.2, $6Grok 4.6: 102.4, $3Grok 4.7: 103.4, $3Claude Haiku 5.5: 103.4, $0.20GPT-6.1 Terra: 105.3, $2Gemini 3.8 Flash: 106.5, $1.50DeepSeek V4.1 Flash 1017: 106.6, $0.26Muse Spark 1.3: 107.4, $2GPT-5.6 Sol: 108.7, $8Claude Fable 5: 112.5, $20Kimi K3.1 Pro: 112.9, $4Muse Wonder: 113.4, $8Claude Opus 5: 117.2, $10GPT-6.1 Sol: 119.2, $4GPT-6 Astra: 121.3, $20Gemini 4 Argon: 122.3, $4Claude Sonnet 5.5: 122.8, $4Claude Fable 5.1: 123.8, $20Claude Opus 5.5: 126.1, $8GPT-6 Sol: 110.5, $4GPT-6 SolClaude Opus 5.5Claude Fable 5.1Claude Sonnet 5.5Gemini 4 ArgonGPT-6 AstraGPT-6.1 SolClaude Opus 5Muse WonderKimi K3.1 ProClaude Fable 5GPT-5.6 SolMuse Spark 1.3DeepSeek V4.1 Flash 1017Gemini 3.8 FlashGPT-6.1 TerraClaude Haiku 5.5Grok 4.7Grok 4.6Kimi K3GPT-5.5MiMo V2.6 ProGPT-5.6 TerraGLM-5.3Qwen 3.8 Max 0902DeepSeek-V4.1-FlashClaude Opus 4.8MiMo V2.6 FlashStep 5 PreviewGemini 3.6 FlashPrice per 1M tokens, blended (log scale)Overall index

GPT-6 Sol by task area

Points, 100 = reference group average · higher is better

MathematicsRank 4 of 47117.5
CodingRank 11 of 109114.9
ReasoningRank 10 of 72114.1
GeneralRank 9 of 65113.0
KnowledgeRank 8 of 32109.8
AgentsRank 16 of 98107.2
MultimodalRank 11 of 47106.9
HealthRank 13 of 72104.8
Legaltoo little data104.8
FinanceRank 30 of 104101.3

Light bar: too few results for a rank yet.

Text Arena

How people rate the answers in blind comparisons, Elo points with style control · higher is better

20 of 40 models

as of October 30, 2026 · Source: LMArena

WebDev Arena

How people rate generated websites and web apps in blind comparisons, Elo points · higher is better

20 of 43 models

as of October 30, 2026 · Source: LMArena

Terminal-Bench 4.0

Share of tasks the model solves as an agent in the terminal, in percent · higher is better

20 of 38 models

as of November 7, 2026 · Source: Vals AI

Vibe Code Bench

Share of apps the model builds correctly from a description, in percent · higher is better

20 of 51 models

as of November 7, 2026 · Source: Vals AI

Show all 744 published benchmark results

Page 1 of 64

Published benchmarks

Coding

LMArena Code Arena WebDev

HTML development

Note (GPT-6 Sol): The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.

Claude Fable 5.11,682.8 rating
GPT-6 Sol1,679.63 rating

higher is betterAs of October 30, 2026Scale: 0 rating - 1,682.8 rating

Source: LMArena
gradually.ai
Methodology and context
Comparison cohort
lmarena-code-webdev:2026-10-28:webdev-html
Metric
WebDev Arena Bradley-Terry rating
Scale
No upper bound is documented. The chart spans the recorded values and zero.
Participants
2
Methodology and context
Arena rating from 1,028 published pairwise votes.. Source model ID: lmarena/GPT-6 Sol (Max). Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Model snapshot: GPT-6 Sol (Max). Evaluator: LMArena. Dataset type: public-crowdsourced-preferences. Leaderboard date: 2026-10-28. Harness: Arena Code Arena WebDev. Reasoning effort: max. Source ID: lmarena. Evidence capture ID: lmarena-webdev-323062f70843f40e3f739865c3fe9d806126e412-4819e4823b65. Source payload hash: 4819e4823b65f309c40ca8ae73130851342e33621e89f30db1c284a7c0d89102. Parser version: lmarena-dataset-v1. Imported at: 2026-10-30
Source: LMArena

Code Migration

Sub-taskGPT-6 Sol (This model)GPT-6 AstraGPT-6.1 SolGPT-5.6 SolGPT-5.6 TerraGPT-6 LunaGPT-5.6 Luna
CLI52.93%67.46% (best value in this row)63.5%47.22%40.41%37.22%36.07%
COBOL70% (best value in this row)68.57%70% (best value in this row)70% (best value in this row)70% (best value in this row)58.57%70% (best value in this row)
Overall57.2%67.74% (best value in this row)65.12%52.92%47.8%42.55%44.55%

higher is betterAs of November 7, 2026Source: Vals AIbars scaled within each row, not across rows

Methodology and context
Metric
accuracy

Code Migration

Code Quality

GPT-6.1 Sol4.5 rating
GPT-6 Astra4.47 rating
GPT-6 Sol4.38 rating
GPT-5.6 Terra3.95 rating
GPT-5.6 Sol3.85 rating
GPT-6 Luna3.75 rating
GPT-5.6 Luna3.2 rating

higher is betterAs of November 7, 2026Scale: 0 rating - 4.5 rating

Source: Vals AI
gradually.ai
Methodology and context
Comparison cohort
vals-code-migration:1:code_quality
Metric
mean reviewer code-quality rating
Scale
No upper bound is documented. The chart spans the recorded values and zero.
Participants
7
Methodology and context
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-29. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 5136.155. Standard error: 0.046. Cost per task in USD: 15.676945. Score display: 4.375 / 5. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-11-07-23c368426e3e. Source payload hash: 23c368426e3e145dbba17219be86d157ba6ebf3b5c25c8f7ba2d5723986fb9b1. Parser version: vals-astro-v4. Imported at: 2026-11-07
Source: Vals AI

General tasks

BioMysteryBench

Sub-taskGPT-6 Sol (This model)GPT-6.1 SolGPT-6 AstraGPT-5.6 SolGPT-5.6 LunaGPT-6 Luna
Hard35.29%39.22% (best value in this row)37.26%29.41%27.45%17.65%
Human-solvable84.02%89.04% (best value in this row)89.04% (best value in this row)80.82%69.41%71.69%
Overall74.82%79.63% (best value in this row)79.26%71.11%61.48%61.48%

higher is betterAs of November 7, 2026Source: Vals AIbars scaled within each row, not across rows

Methodology and context
Metric
accuracy

Cybersecurity

CyberBench v1.1

Sub-taskGPT-6 Sol (This model)GPT-5.6 SolGPT-6 LunaGPT-5.6 LunaGPT-5.6 TerraGPT-6 AstraGPT-6.1 Sol
Overall77.98% (best value in this row)76.31%76.25%73.63%72.08%41.07%39.29%
Patch89.29% (best value in this row)89.29% (best value in this row)87.5%83.93%87.5%82.14%78.57%
PoC66.67% (best value in this row)63.33%65%63.33%56.67%0%0%

higher is betterAs of November 7, 2026Source: Vals AIbars scaled within each row, not across rows

Methodology and context
Metric
accuracy

Recorded measurement details

LMArena Code Arena WebDev: HTML development (Show measurement, test conditions, and source)
Source value
1679.6279514642752
Score
1679.6279514642752
Metric
WebDev Arena Bradley-Terry rating
Unit
rating
Benchmark version
webdev
Category
coding
Task
webdev-html
Task label
HTML development
Direction
Higher is better
Comparison cohort
lmarena-code-webdev:2026-10-28:webdev-html
Confidence interval
21.58371
Source type
official-leaderboard
Evaluator
LMArena
Status
active
Retrieved at
2026-10-30
Methodology
Arena rating from 1,028 published pairwise votes.. Source model ID: lmarena/GPT-6 Sol (Max). Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Model snapshot: GPT-6 Sol (Max). Evaluator: LMArena. Dataset type: public-crowdsourced-preferences. Leaderboard date: 2026-10-28. Harness: Arena Code Arena WebDev. Reasoning effort: max. Source ID: lmarena. Evidence capture ID: lmarena-webdev-323062f70843f40e3f739865c3fe9d806126e412-4819e4823b65. Source payload hash: 4819e4823b65f309c40ca8ae73130851342e33621e89f30db1c284a7c0d89102. Parser version: lmarena-dataset-v1. Imported at: 2026-10-30
Comparison methodology
Arena rating from 1,028 published pairwise votes.. Harness: Arena Code Arena WebDev. Reasoning effort: max
Context
The Arena score measures human preference rather than a fixed capability test. The confidence interval, Arena category, and model configuration are part of the result.
Source LMArena
BioMysteryBench: Hard (Show measurement, test conditions, and source)
Source value
35.294
Score
35.294
Metric
accuracy
Unit
%
Benchmark version
1
Category
general
Task
human_difficult
Task label
Hard
Direction
Higher is better
Comparison cohort
vals-biomysterybench:1:human_difficult
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-11-05. Harness: Terminus 2. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 502.413. Standard error: 0. Cost per task in USD: 1.113779. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-11-07-c2992129e13e. Source payload hash: c2992129e13e1455796b51fe354f18fa049ad9dcfe02fd66196230a60aeea9df. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Harness: Terminus 2. Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
BioMysteryBench: Human-solvable (Show measurement, test conditions, and source)
Source value
84.018
Score
84.018
Metric
accuracy
Unit
%
Benchmark version
1
Category
general
Task
human_solvable
Task label
Human-solvable
Direction
Higher is better
Comparison cohort
vals-biomysterybench:1:human_solvable
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-11-05. Harness: Terminus 2. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 283.024. Standard error: 2.994. Cost per task in USD: 0.557233. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-11-07-c2992129e13e. Source payload hash: c2992129e13e1455796b51fe354f18fa049ad9dcfe02fd66196230a60aeea9df. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Harness: Terminus 2. Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
BioMysteryBench: Overall (Show measurement, test conditions, and source)
Source value
74.815
Score
74.815
Metric
accuracy
Unit
%
Benchmark version
1
Category
general
Task
overall
Task label
Overall
Direction
Higher is better
Comparison cohort
vals-biomysterybench:1:overall
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-11-05. Harness: Terminus 2. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 324.465. Standard error: 2.429. Cost per task in USD: 0.662358. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-11-07-c2992129e13e. Source payload hash: c2992129e13e1455796b51fe354f18fa049ad9dcfe02fd66196230a60aeea9df. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Harness: Terminus 2. Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
Code Migration: CLI (Show measurement, test conditions, and source)
Source value
52.927
Score
52.927
Metric
accuracy
Unit
%
Benchmark version
1
Category
coding
Task
cli
Task label
CLI
Direction
Higher is better
Comparison cohort
vals-code-migration:1:cli
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-29. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 6436.976. Standard error: 2.372. Cost per task in USD: 20.385725. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-11-07-23c368426e3e. Source payload hash: 23c368426e3e145dbba17219be86d157ba6ebf3b5c25c8f7ba2d5723986fb9b1. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
Code Migration: COBOL (Show measurement, test conditions, and source)
Source value
70
Score
70
Metric
accuracy
Unit
%
Benchmark version
1
Category
coding
Task
cobol
Task label
COBOL
Direction
Higher is better
Comparison cohort
vals-code-migration:1:cobol
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-29. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 1233.694. Standard error: 15.275. Cost per task in USD: 1.550605. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-11-07-23c368426e3e. Source payload hash: 23c368426e3e145dbba17219be86d157ba6ebf3b5c25c8f7ba2d5723986fb9b1. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
Code Migration: Overall (Show measurement, test conditions, and source)
Source value
57.195
Score
57.195
Metric
accuracy
Unit
%
Benchmark version
1
Category
coding
Task
overall
Task label
Overall
Direction
Higher is better
Comparison cohort
vals-code-migration:1:overall
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-29. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 5136.155. Standard error: 4.213. Cost per task in USD: 15.676945. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-11-07-23c368426e3e. Source payload hash: 23c368426e3e145dbba17219be86d157ba6ebf3b5c25c8f7ba2d5723986fb9b1. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
Code Migration: Code Quality (Show measurement, test conditions, and source)
Source value
4.375
Score
4.375
Metric
mean reviewer code-quality rating
Unit
rating
Benchmark version
1
Category
coding
Task
code_quality
Task label
Code Quality
Direction
Higher is better
Comparison cohort
vals-code-migration:1:code_quality
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-10-29. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 5136.155. Standard error: 0.046. Cost per task in USD: 15.676945. Score display: 4.375 / 5. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-11-07-23c368426e3e. Source payload hash: 23c368426e3e145dbba17219be86d157ba6ebf3b5c25c8f7ba2d5723986fb9b1. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
CyberBench v1.1: Overall (Show measurement, test conditions, and source)
Source value
77.976
Score
77.976
Metric
accuracy
Unit
%
Benchmark version
1.1
Category
cybersecurity
Task
overall
Task label
Overall
Direction
Higher is better
Comparison cohort
vals-cyberbench:1.1:overall
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-11-05. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 734.454. Standard error: 5.11. Cost per task in USD: 1.338572. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-11-07-cc5fe09bf1f8. Source payload hash: cc5fe09bf1f8c926613f8893f823a902fb33f219303590d6a2794e43708d67a5. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
CyberBench v1.1: Patch (Show measurement, test conditions, and source)
Source value
89.286
Score
89.286
Metric
accuracy
Unit
%
Benchmark version
1.1
Category
cybersecurity
Task
patch
Task label
Patch
Direction
Higher is better
Comparison cohort
vals-cyberbench:1.1:patch
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-11-05. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 686.527. Standard error: 4.133. Cost per task in USD: 0.738255. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-11-07-cc5fe09bf1f8. Source payload hash: cc5fe09bf1f8c926613f8893f823a902fb33f219303590d6a2794e43708d67a5. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI
CyberBench v1.1: PoC (Show measurement, test conditions, and source)
Source value
66.667
Score
66.667
Metric
accuracy
Unit
%
Benchmark version
1.1
Category
cybersecurity
Task
poc
Task label
PoC
Direction
Higher is better
Comparison cohort
vals-cyberbench:1.1:poc
Source type
independent-evaluator
Evaluator
Vals AI
Status
active
Retrieved at
2026-11-07
Methodology
Source model ID: openai/gpt-6-sol. Source model name: GPT-6 Sol. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-11-05. Reasoning effort: max. Maximum output tokens: 128000. Latency in seconds: 782.382. Standard error: 6.086. Cost per task in USD: 1.93889. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-11-07-cc5fe09bf1f8. Source payload hash: cc5fe09bf1f8c926613f8893f823a902fb33f219303590d6a2794e43708d67a5. Parser version: vals-astro-v4. Imported at: 2026-11-07
Comparison methodology
Reasoning effort: max. Maximum output tokens: 128000
Source Vals AI

Page 1 of 64

See for yourself: one prompt, one attempt

We show the latest attempt without fixes; it does not count toward the overall index.

GPT-6 Sol: Pelican on a bicycle
A community classic for free-form SVG drawing.

Pelican on a bicycle

Prompt

Generate an SVG of a pelican riding a bicycle

Oct 1, 2026 · 80 s · $0.04

Test details
Run date
Oct 1, 2026
API provider
openrouter
Requested API model
openai/gpt-6-sol
Reasoning setting
high
Token limit including reasoning
8,192 tokens
Output tokens
4,389 tokens
Cost of the attempt
$0.0439
Response time
80.5 s
API model reported in response
openai/gpt-6-sol
Pinned endpoint
OpenAI | openai/gpt-6-sol-20260922
Temperature
Provider default
Test protocol
community-visual-tests-v1
Technical checks
Passed, not a quality rating

Visually reviewed. This individual test does not establish overall model quality.

Task origin: Simon Willison
SVG short test

SVG short test

One SVG task with the same fixed settings for every model, without hidden thinking.

GPT-6 Sol

Unavailable in this round

Popularity compared

How often the model is searched for, used and mentioned, compared with every model of its category.

Popularity index

The 100 most popular models of this category, 0 to 100, higher is more popular

20 of 100 models

As of November 2026 · Source: gradually.ai popularity index

Over time

Weekly values from October 18, 2026 to November 7, 2026

GPT-6 SolClaude Haiku 5.5 77DeepSeek V4.1 Flash 1017 69Claude Opus 5.5 68Qwen 3.8 27B 68

Method changes in the timeline, a jump at these points is no market event:

  1. 1November 1, 2026: Value only with search or usage data, 30-day attention

What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.

GPT-6 Sol compared

Compare with another model

The most popular comparisons

  1. 1GPT-6 Sol vs. GPT-5.6 Sol
  2. 2GPT-6 Sol vs. DeepSeek-V4.1-Flash
  3. 3GPT-6 Sol vs. Gemini 3.8 Flash
  4. 4GPT-6 Sol vs. GPT-5.6 Terra
  5. 5GPT-6 Astra vs. GPT-6 Sol
  6. 6GPT-6 Sol vs. GLM-5.3-Flash
  7. 7Claude Sonnet 5.5 vs. GPT-6 Sol
  8. 8GPT-6 Sol vs. Gemini 3.1 Pro Preview
  9. 9Claude Opus 4.8 vs. GPT-6 Sol
Show all 56 comparisons
  1. 10GPT-6 Sol vs. GPT-5.4
  2. 11GPT-6 Sol vs. DeepSeek V4.1 Flash 1017
  3. 12GPT-6 Sol vs. Qwen 3.8 27B
  4. 13GPT-6 Sol vs. GPT-6 Luna
  5. 14GPT-6 Sol vs. Kimi K3.1 Pro
  6. 15Claude Sonnet 4.6 vs. GPT-6 Sol
  7. 16GPT-6 Sol vs. Grok 4.7
  8. 17Claude Haiku 5.5 vs. GPT-6 Sol
  9. 18Claude Opus 5.5 vs. GPT-6 Sol
  10. 19GPT-6 Sol vs. Qwen 3.8 Max 0902
  11. 20Claude Sonnet 5 vs. GPT-6 Sol
  12. 21GPT-6 Sol vs. Kimi K3
  13. 22Claude Fable 5.1 vs. GPT-6 Sol
  14. 23GPT-6 Sol vs. DeepSeek-V4-Pro
  15. 24GPT-6 Sol vs. GPT-5.6 Luna
  16. 25Claude Opus 5 vs. GPT-6 Sol
  17. 26GPT-6 Sol vs. Mistral Large 4
  18. 27GPT-6 Sol vs. Gemini 4 Argon
  19. 28GPT-6 Sol vs. Gemini 3.6 Flash
  20. 29Claude Opus 4.6 vs. GPT-6 Sol
  21. 30GPT-6 Sol vs. Muse Wonder
  22. 31Claude Haiku 4.5 vs. GPT-6 Sol
  23. 32GPT-6 Sol vs. GPT-5.5
  24. 33GPT-6.1 Terra vs. GPT-6 Sol
  25. 34GPT-6 Sol vs. Gemini 4 Carbon
  26. 35Claude Fable 5 vs. GPT-6 Sol
  27. 36Claude Opus 4.7 vs. GPT-6 Sol
  28. 37Claude Opus 4.5 vs. GPT-6 Sol
  29. 38Claude Sonnet 4.5 vs. GPT-6 Sol
  30. 39GPT-6 Sol vs. GPT-5.4 mini
  31. 40GPT-6 Sol vs. Gemini 3.7 Flash
  32. 41GPT-6 Sol vs. Gemini 3.5 Flash
  33. 42GPT-6 Sol vs. Gemini 3.5 Flash-Lite
  34. 43GPT-6 Sol vs. Muse Wonder Full
  35. 44GPT-6 Sol vs. Muse Spark 1.3
  36. 45GPT-6 Sol vs. Grok 4.6
  37. 46GPT-6 Sol vs. Grok 4.5
  38. 47GPT-6 Sol vs. Grok 4.3
  39. 48GPT-6 Sol vs. DeepSeek-V4-Flash
  40. 49GPT-6 Sol vs. Kimi K2.6
  41. 50GPT-6 Sol vs. GLM-5.3
  42. 51GPT-6 Sol vs. GLM-5.2
  43. 52GPT-6 Sol vs. GLM-5.1
  44. 53GPT-6 Sol vs. Mistral Large 3
  45. 54GPT-6 Sol vs. Mistral Medium 3.5
  46. 55GPT-6 Sol vs. MiMo-V2.5
  47. 56GPT-6 Sol vs. MiMo-V2.5-Pro

All specifications

Architecture

Knowledge cutoff
April 20, 2026
Source: Knowledge cutoff

Input and output

Context window
1,050,000 tokens
Source: Context window
Maximum output
128,000 tokens
Source: Maximum output
Input
Text, Image
Source: Input
Output
Text
Source: Output
Reasoning mode
none, low, medium, high, xhigh, max
Source: Reasoning mode
Tool calling
Yes
Source: Tool calling

Watermarking and provenance

AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.

AI watermarking
Unknown
no source
Watermarking technique
Not known
no source

Licence and access

Weights
Proprietary
Source: Weights
Release
Sep 22, 2026
Source: Release

API

API model ID
gpt-6-sol
Source: API model ID

Further details

Notes
Released September 22, 2026 as the second GPT-6 tier below GPT-6 Astra, built by OpenAI for complex coding and agentic workflows. 1.05 million token context window, 128,000 maximum output tokens, and an April 20, 2026 knowledge cutoff. API price $2 / $10 per million input and output tokens, half of GPT-5.6 Sol's promotional price. Reasoning effort from none to max, with medium as the default. Official API ID: gpt-6-sol.
Source: Notes

Prices

Choose a price view

8 offers, prices in US dollars per 1M tokens, blended from 3 parts input and 1 part output.

Filter offers
ProviderInputOutputCache readCache writeBlended
OpenAIdirect$2$10$0.20$2.50$4
OpenAIabove 272,000 context tokensdirect$4$15$0.40$5$6.75
OpenAIFlex$1$5n/an/a$2
Amazon BedrockGlobal$2$10n/an/a$4
Azure$2$10n/an/a$4
Amazon BedrockUs-east-1$2.20$11n/an/a$4.40
AzureEU$2.20$11n/an/a$4.40
AzureUS$2.20$11n/an/a$4.40
OpenAIFast$4$20n/an/a$8

Cache prices come from the direct tariff; OpenRouter does not report them for the other providers. Direct price according to the developer, checked Sep 22, 2026. Provider prices via OpenRouter, as of Nov 7, 2026. Open the LLM price index

2 price changes since tracking began.

InputOutput

$0$5$10$15Sep 22, 2026Nov 7, 2026
Daily observed price in the LLM price index in US dollars per 1M tokens. The index uses a market price from several sources, which can differ from the developer's direct price.

At OpenAI from $20 a month (ChatGPT Plus). Through other providers from $6 a month (ElevenLabs Starter, with limited credits). 57 plans in Germany.

Filter plans
PlanMonthly list priceNote
ChatGPT PlusOpenAI$20developer's own plan
ChatGPT Business Standard-PlatzOpenAI$25developer's own plan, with limited credit, for teams, per seat
ChatGPT Pro $100OpenAI$100developer's own plan, with limited credit
ChatGPT Business Premium-PlatzOpenAI$125developer's own plan, with limited credit, for teams, per seat
ChatGPT EnterpriseOpenAIn/adeveloper's own plan, for enterprises, per seat
ChatGPT Pro $500OpenAI$500developer's own plan, with limited credit
ElevenLabs Freefreewith limited credit
Genspark Freefreewith limited credit
JetBrains AI Freefreewith limited credit
Lovable Freefreewith limited credit
Zed Studentfree
ElevenLabs Starter$6with limited credit
Poe Basic$4.99with limited credit
Zed Pro$10
JetBrains AI Pro$10with limited credit
GitHub Copilot Business$19with limited credit, for teams, per seat
Command Code Pro$20with limited credit
Replit Core$20
ElevenLabs Creator$22with limited credit
JetBrains AI Pro$20with limited credit, for teams, per seat
Lovable Pro$25with limited credit
Genspark Plus$24.99with limited credit
Poe Plus$19.99with limited credit
Langdock Business Standard€25for teams, per seat
JetBrains AI Ultimate$30with limited credit
GitHub Copilot Enterprise$39with limited credit, for enterprises, per seat
GitHub Copilot Pro+$39with limited credit
Genspark for Business Team$40with limited credit, for teams, per seat
Lovable Business$50with limited credit, for teams
Mindverse Studio Team€49for teams, per seat
Poe Pro$49.99with limited credit
Higgsfield Plus€59with limited credit
Mindverse Studio Pro€59per seat
JetBrains AI Ultimate$60with limited credit, for teams, per seat
Higgsfield Team€79with limited credit, for teams, per seat
ElevenLabs Pro$99with limited credit
Command Code Max 10×$100with limited credit
GitHub Copilot Max$100with limited credit
Replit Pro$100
Krea Max$105with limited credit
Langdock Business Max€99for teams, per seat
Poe Advanced$99.99with limited credit
Higgsfield Ultra€129with limited credit
Higgsfield Scale€169with limited credit, for teams, per seat
Command Code Max 20×$200with limited credit
Krea Business$200with limited credit, for teams
Genspark Pro$249.99with limited credit
ElevenLabs Scale$299with limited credit, for teams
Poe Max$249.99with limited credit
ElevenLabs Business$990with limited credit, for teams
ElevenLabs Enterprisen/afor enterprises
Genspark for Business Enterprisen/awith limited credit, for enterprises, per seat
Higgsfield Enterprisen/afor enterprises
JetBrains AI Enterprisen/awith limited credit, for enterprises, per seat
Krea Enterprisen/afor enterprises
Lovable Enterprisen/afor enterprises
Replit Enterprisen/afor enterprises

All plans in the AI subscription comparison

Frequently asked questions about GPT-6 Sol

How good is GPT-6 Sol in benchmarks?

Good: Rank 13 of 92 in the overall index.

Overall index (Gradually Meta-Score v4) from 40 benchmark results · data through Nov 7, 2026

IntelligenceOverall index in points, 100 = reference group average · higher is better
Muse Wonder113.4
Kimi K3.1 Pro112.9
Claude Fable 5112.5
GPT-6 SolRank 13110.5
GPT-5.6 Sol108.7
Muse Spark 1.3107.4
Gemini 3.7 Flash107.1

What is the Overall index (Gradually Meta-Score v4)?

A point value that combines many independent benchmarks into one number. 100 points is the average of a fixed reference group, higher is better. GPT-6 Sol scores 110.5 points, which is rank 13 of 92.

Own analysis by gradually.ai, method benchmark-meta-score-v4 · for GPT-6 Sol from 40 test series

Which data
Only current, reviewed results from independent evaluators such as Artificial Analysis, Vals AI, LMArena, LiveBench and Epoch AI. Vendor claims and historical or disputed values do not count.
One value per test
For each source and test series the latest retrieval with one fixed setup counts. When a source tests several reasoning levels, the highest documented one applies. A series needs at least 5 models.
Making tests comparable
Percentages are converted so that gaps near 0 and near 100 % count fairly, then every series is put on the same scale. A hard test therefore does not weigh more than an easy one.
Shared strength
A statistical model estimates, from all series at once, one shared capability per model and, per area, how far a model deviates from it. Missing tests are never counted as zero.
Weighting
Core areas (Coding, Reasoning, Mathematics, Knowledge, Agents, General and Multimodal) count 75 % together, the domain areas Finance, Legal and Health 25 %.
The point scale
The value is measured against a fixed reference group of 29 models, much like an IQ score: 100 points is its average and 15 points one standard deviation of the group. The scale is open at both ends and is not a percentage. A model 15 points ahead does better in roughly three of four benchmark comparisons. New models do not shift older values.
Place by score
The place follows the order of the scores among all models with a place, such as "rank 14 of 95". A second calculation checks whether a lead is reliable by recomputing the score 200 times with randomly redrawn test families. If a model is not almost always ahead there, the two models count as level.
Minimum evidence
A value needs at least 8 test series from 2 sources and 3 areas, a place only with enough precision. Missing core areas are flagged as "estimated".
What it is not
Not a test run by gradually.ai and no verdict on every single task. For a specific task the area values and the individual benchmarks matter more.

How much does GPT-6 Sol cost?

Through the API $2 per 1M input tokens and $10 output. That is fairly expensive.

Prices from Nov 7, 2026

Output price since tracking beganDollars per 1M tokens · lower is better

Sep 22, 2026Nov 7, 2026

First price on Sep 22, 2026: $10. Since Sep 24, 2026: $10.

What is the knowledge cutoff of GPT-6 Sol?

Apr 20, 2026, according to OpenAI. That is 5 months before release.

Stated by OpenAI

How large is the context window of GPT-6 Sol?

1.05 M tokens. That is how much text GPT-6 Sol reads at once, about 1,580 A4 pages.

Page count as a rule of thumb from Artificial Analysis

Context windowTokens the model reads at once · higher is better
GPT-6 SolRank 2 of 1021.05M
GPT-5.6 Sol1.05M
Kimi K3.1 Pro1.05M
Muse Spark 1.31.05M
Muse Wonder1.05M
Gemini 3.7 Flash1.05M
Claude Fable 51M

How fast is GPT-6 Sol?

111 tokens per second. That is faster than a typical model at 87.

Measured by Artificial Analysis on Nov 6, 2026. AA 3.0.0, including time to first token, averaged across available workloads and five days.

SpeedTokens per second · higher is better
Muse Wonder124
Muse Spark 1.3120
GPT-6 SolRank 33 of 100111
GPT-5.6 Sol101
Claude Fable 586
Claude Opus 566
Kimi K3.1 Pro33

Can I run GPT-6 Sol locally?

No. OpenAI does not publish the weights.

Stated by OpenAI

Open weights
no
License
n/a
Parameters
n/a
active per token
n/a

Where can I use GPT-6 Sol?

At OpenAI with a subscription from $20 a month. Including other providers that makes 57 plans in Germany, plus the API.

Subscription comparison, prices in Germany incl. VAT

At OpenAI

6 plans, from $20 a month (ChatGPT Plus).

Through other providers

51 plans from 13 providers, from $6 a month (ElevenLabs Starter), with limited credits.

Through the API

$2 input, $10 output per 1M tokens, unchanged since Sep 24, 2026.

Sources and data date

Show all 103 sources

Benchmark sources at a glance

Which independent evaluators tested this model. This is coverage, not a quality ranking.

EvaluatorTest seriesComposite indicesRecorded active measurements
Artificial Analysis12024
Vals AI201149
LMArena4042
LiveBench0038
Epoch AI6015
ARC Prize0024
Scale AI Evals008

Without vendor claims and historical or disputed results; those stay labelled in the single values. 80 measurements are not yet assigned to a test series.

TypeEvidence and data date
Speed

OpenAI, Max effort. AA 3.0.0, including time to first token, averaged across available workloads and five days. Retrieved November 6, 2026.

Price

Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs.

Input

Documented modalities. Retrieved September 22, 2026.

Output

Documented modalities. Retrieved September 22, 2026.

Research statusResearch date September 22, 2026. 69 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not found in the inspected sources

parameters-billions

Original wording

OpenAI does not publish parameter counts.

Unresolved

fresh-agent-arena-leaderboard

Note

The current Agent Arena leaderboard was reviewed in the rendered web reader, but the raw endpoint returned HTTP 403. No dynamic values were added without a complete captured source body.

Not published

immutable-serving-revision

Note

The evaluator names the exact gpt-6-sol route and dated environment but does not publish the underlying immutable serving snapshot or exact hidden runtime version.

Not published

serving-revision-and-test-denominators

Note

ARC Prize pages do not state per-row N, CI, or immutable served revision. Parallel omits model snapshot and varies reasoning/token limits by provider guidance.

Not published

PRBench row subset and model-specific run settings

Note

The current leaderboard page does not identify whether this row uses the full or hard subset, or publish the model-specific generation settings or measurement date.

Additional sourceModel metadata (retrieved September 22, 2026; October 19, 2026) · Introducing GPT-6 Sol and GPT-6 Luna · Editorial description reviewed October 4, 2026
Additional sourceArtificial Analysis (retrieved October 19, 2026; November 7, 2026)1234567
Additional sourceArtificial Analysis (retrieved October 19, 2026)123
Additional sourceArtificial Analysis (retrieved November 7, 2026)123
Additional sourceArtificial Analysis (retrieved October 19, 2026; November 2, 2026)
Additional sourceArtificial Analysis (retrieved October 19, 2026; October 29, 2026; November 2, 2026; November 7, 2026)
Additional sourceArtificial Analysis (retrieved October 19, 2026; November 2, 2026; November 7, 2026)12
Additional sourceLMArena (retrieved October 30, 2026)1234
Additional sourceLMArena (retrieved October 28, 2026)12
Additional sourceLMArena (retrieved October 16, 2026)1234
Additional sourceVals AI (retrieved November 7, 2026)123456789101112131415161718
Additional sourceVals AI (retrieved October 16, 2026)123
Additional sourceVals AI (retrieved October 16, 2026; October 31, 2026; November 7, 2026)
Additional sourceVals AI (retrieved October 17, 2026; November 7, 2026)
Additional sourceVals AI (retrieved October 16, 2026; October 30, 2026; October 31, 2026)
Additional sourceLiveBench (retrieved October 16, 2026)1 (unavailable on November 2, 2026) https://livebench.ai/table_2026_09_02.csv2 (unavailable on November 2, 2026) https://livebench.ai/breakdown_2026_09_02.json
Additional sourceArena AI (retrieved October 17, 2026)
Additional sourceJoonlab GPT-6.1 Sol benchmark, pinned reasoning summary (retrieved October 17, 2026)
Additional sourceARC Prize Verified Leaderboard (retrieved October 17, 2026)
Additional sourceParallel Search Capability Leaderboard (retrieved October 17, 2026)
Additional sourceAndroid Developers, Android Bench leaderboard (retrieved October 17, 2026)
Additional sourceVetEval, GPT-6 Sol model page (retrieved October 17, 2026)
Additional sourceMadrid-García and Merino-Barbancho, Jev in Medicine: A Benchmark Evaluation (retrieved October 17, 2026)
Additional sourceBizBench research team, long-horizon business-agent benchmark (retrieved October 17, 2026)
Additional sourceJoonlab GPT-6.1 Sol benchmark, pinned data commit (retrieved October 17, 2026)123
Additional sourceEpoch AI, AI systems are improving rapidly at Slay the Spire and its sequel (retrieved October 17, 2026)
Additional sourceVeriContest paper authors (retrieved October 18, 2026)
Additional sourceEpoch AI benchmark run dataset snapshot (retrieved October 19, 2026; October 28, 2026)
Additional sourceRoboflow Vision Evals (retrieved October 19, 2026; October 28, 2026)
Additional sourceAgent Arena (retrieved October 20, 2026)
Additional sourceVulcanBench (retrieved October 20, 2026)
Additional sourceDuelLab GameBench 2 (retrieved October 20, 2026; October 28, 2026; November 2, 2026; November 5, 2026)
Additional sourceTrueStandard (retrieved October 20, 2026)
Additional sourceTowards AI ToneBench (retrieved October 20, 2026; October 28, 2026; October 30, 2026)
Additional sourceSonarSource (retrieved October 20, 2026)
Additional sourceOpenAI (retrieved October 23, 2026)
Additional sourceOpenAI Deployment Safety Hub, GPT-6.1 Sol system-card addendum (retrieved October 23, 2026)
Additional sourceOpenAI, GPT-6.1 Sol System Card Addendum (retrieved October 23, 2026)
Additional sourceScale AI (retrieved October 28, 2026)
Additional sourceGoogle DeepMind on Kaggle (retrieved October 28, 2026)
Additional sourceGoogle on Kaggle (retrieved October 28, 2026)123456
Additional sourceTerminal-Bench (retrieved October 28, 2026)
Additional sourceParallel Search Capability Leaderboard (retrieved October 28, 2026; November 5, 2026)
Additional sourceTowards AI ToneBench (retrieved October 28, 2026; October 30, 2026)
Additional sourceScale AI Labs (retrieved October 28, 2026)
Additional sourceScale AI HSS (retrieved October 28, 2026)
Additional sourceScale AI DistressBench (retrieved October 28, 2026)
Additional sourceScale AI FORTRESS (retrieved October 28, 2026)
Additional sourceParallel Search Capability Leaderboard (retrieved November 5, 2026)
Additional sourceOpenRouter: Popularity index (derived), CC BY 4.0
Additional sourceVercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional sourceOllama: cumulative downloads for the popularity index
Additional sourceReplicate: cumulative runs for the popularity index
Additional sourceGoogle Trending Now: limited feed selection for Germany and the US
Additional sourceCreative Commons Attribution 4.0