GPT-5.6 Terra
Unavailable in this round
Language modelActive
GPT-5.6 Terra
OpenAI
- Released
- July 9, 2026
- Data date
- September 8, 2026
- Benchmark-Meta-Score
- Provisional, 55.2 % panel coverage
- Speed
- 113.5 tokens/sOutput throughput
- Price
- Input · Output / 1M tokens
- Input
- Text, Image
- Output
- Text
OpenAI made GPT-5.6 Terra the default tier for Free and Go users in ChatGPT Work and Codex. Paid users could select Terra alongside GPT-5.6 Sol and GPT-5.6 Luna and choose its reasoning effort.
Terra also supports the programmatic tool calling introduced with GPT-5.6. The model coordinates tools through programs it writes and filters intermediate results before continuing its work.
- Position
- Rank 19 of 24
- Index score
- 31.3 / 100
Methodology and source
The LLM comparison hub's selected-panel index averages rank percentiles from 10 documented comparison cohorts. Benchmark meta-scores are shown in the benchmark section.
Benchmark meta-analysis
Overall and area scores
These Gradually indexes place selected published measurements on a 0 to 100 scale. They are not accuracy percentages and do not guarantee results in your application.
Retrieval dates of the sources used 2026-10-15 - 2026-10-19
Overall index
Index 63.7 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 55 %
- Test families
- 41 / 71
- Sources
- 3
- Mathematical bounds with missing values
- 35.1-79.9 / 100
Coding
Index 69.1 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 56 %
- Test families
- 9 / 15
- Sources
- 2
- Mathematical bounds with missing values
- 38.4-82.8 / 100
Reasoning
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 43 %
- Test families
- 4 / 7
- Sources
- 2
- Mathematical bounds with missing values
- 36.4-93.5 / 100
Mathematics
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 20 %
- Test families
- 1 / 5
- Sources
- 1
- Mathematical bounds with missing values
- 12.8-92.8 / 100
Knowledge
Index 58.1 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 67 %
- Test families
- 2 / 3
- Sources
- 2
- Mathematical bounds with missing values
- 38.7-72.1 / 100
Agents
Index 80.3 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 6 / 12
- Sources
- 2
- Mathematical bounds with missing values
- 40.1-90.1 / 100
General
Index 57.0 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 60 %
- Test families
- 3 / 5
- Sources
- 3
- Mathematical bounds with missing values
- 34.2-74.2 / 100
Finance
Index 73.4 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 86 %
- Test families
- 6 / 7
- Sources
- 1
- Mathematical bounds with missing values
- 62.9-77.2 / 100
Legal
Index 58.5 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 75 %
- Test families
- 3 / 4
- Sources
- 1
- Mathematical bounds with missing values
- 43.9-68.9 / 100
Health
Index 49.6 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 67 %
- Test families
- 2 / 3
- Sources
- 1
- Mathematical bounds with missing values
- 33.1-66.4 / 100
Cybersecurity
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 100 %
- Test families
- 1 / 1
- Sources
- 1
- Mathematical bounds with missing values
- 71.2-71.2 / 100
Multimodal
Index 60.0 / 100
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 2 / 4
- Sources
- 3
- Mathematical bounds with missing values
- 30.0-80.0 / 100
Productivity
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 1 / 2
- Sources
- 1
- Mathematical bounds with missing values
- 22.4-72.4 / 100
Education
Not enough coverage for a score yet
provisional
Published configurations differ within this comparison cohort. Treat the index as provisional.
- Panel-weight coverage
- 50 %
- Test families
- 1 / 2
- Sources
- 1
- Mathematical bounds with missing values
- 27.6-77.6 / 100
Documented method · Included test families and measurements
Method version: benchmark-meta-score-v1
The index includes active measurements from reviewed primary sources when at least five models are compared in the same documented comparison slice across dataset, harness, agent, tools, and trial count. Each benchmark series and evaluator contributes one shared setup slice from the newest capture; when dates match, the wider slice is used. When one source and series include several explicitly documented reasoning tiers, the highest documented tier (none through max) is selected, never the best result value. The explicit source label “Non-reasoning” is treated as none. When selecting between multiple results, unknown or ambiguous tiers exclude the model from that series. Unambiguous single configurations do not require a tier ordering. The best individual result for each model is not selected. Equal raw values share the same rank percentile. Multiple series from the same evaluator within a family receive equal weight; evaluators within a family, families within an area, and areas in the overall index then receive equal weight. Unmeasured series remain visible in coverage and bounds. An overall score requires at least four areas, six test families, and two sources. An area score requires at least two test families. Every overall and area score also requires at least 50% of its panel weight.
Published model-specific parameters can differ. This is not a controlled experiment; comparisons with such differences are marked provisional.
Unmeasured portions are not entered as zero. They reduce coverage and contribute only to the displayed bounds. Scores with different coverage are therefore not equally complete.
The bounds hold observed percentiles fixed and allow missing contributions anywhere from 0 to 100. They are not confidence intervals or predictions of future recalculations.
The source count is not a count of independent experiments.
OECD handbook on composite indicatorsAll 41 test families and 12 of 45 raw measurements are listed here. The complete calculation for every model is available in the JSON export.
Test family: AA-Briefcase
Agents · Family index: 72.0 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-aa-briefcase
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 1,334.22 Elo
- Metric:
- AA-Briefcase Elo
- Version:
- v1.1
- Participating models:
- 83
- Rank percentile within the cohort:
- 72.0 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-aa-briefcase:v1.1:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-aa-briefcase","v1.1","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: AA-LCR
Reasoning · Family index: 88.4 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-aa-lcr
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.02 %
- Raw value:
- 83 %
- Metric:
- Pass rate
- Version:
- v1.1
- Participating models:
- 83
- Rank percentile within the cohort:
- 88.4 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-aa-lcr:v1.1:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-aa-lcr","v1.1","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 83.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: APEX-Agents-AA
Agents · Family index: 88.5 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-apex-agents-aa
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 38.9380530973451 %
- Metric:
- Pass@1 success rate
- Version:
- AA public cohort: 452 tasks
- Participating models:
- 27
- Rank percentile within the cohort:
- 88.5 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-apex-agents-aa:AA public cohort: 452 tasks:standalone:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-apex-agents-aa","AA public cohort: 452 tasks","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Harness:
- Artificial Analysis Stirrup
- Agent:
- Stirrup agent
- Tool policy:
- 200-turn cap; MCP-backed workplace tools in Archipelago
- Attempts:
- pass@1, averaged over 3 repeats per task
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption. 452 tasks from the public 480-task release, with three repeats per task. A run passes only if every rubric criterion is satisfied; the leaderboard averages pass@1 across repeats.. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: 200-turn cap; MCP-backed workplace tools in Archipelago. Attempts: pass@1, averaged over 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption. 452 tasks from the public 480-task release, with three repeats per task. A run passes only if every rubric criterion is satisfied; the leaderboard averages pass@1 across repeats.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: 200-turn cap; MCP-backed workplace tools in Archipelago. Attempts: pass@1, averaged over 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 38.9%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: AutomationBench-AA
Agents · Family index: 82.9 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-automationbench-aa
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 59.64995802534495 %
- Metric:
- Objectives completed without guardrail violations
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 82.9 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-automationbench-aa:unspecified:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-automationbench-aa","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 59.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: GDP.pdf
Reasoning · Family index: 90.2 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-gdp-pdf
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.02 %
- Raw value:
- 24 %
- Metric:
- All-pass rate
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 90.2 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-gdp-pdf:unspecified:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-gdp-pdf","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 24.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: GDPval-AA
Agents · Family index: 74.4 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-gdpval-aa
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 1,451.58 Elo
- Metric:
- GDPval-AA Elo
- Version:
- v2.1
- Participating models:
- 83
- Rank percentile within the cohort:
- 74.4 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-gdpval-aa:v2.1:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-gdpval-aa","v2.1","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: IFBench
General · Family index: 71.0 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-ifbench
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.43 %
- Raw value:
- 71.2244897959184 %
- Metric:
- IFBench prompt-level loose accuracy (pass@1)
- Version:
- AA test set: 294 questions
- Participating models:
- 70
- Rank percentile within the cohort:
- 71.0 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-ifbench:AA test set: 294 questions:standalone:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-ifbench","AA test set: 294 questions","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Tool policy:
- Single-turn answer evaluated with the official IFBench source code
- Attempts:
- pass@1, 5 repeats per question
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption. Artificial Analysis runs 294 questions from the IFBench test set with five repeats per question. The official evaluator scores prompt-level accuracy in loose mode as pass@1.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Tool policy: Single-turn answer evaluated with the official IFBench source code. Attempts: pass@1, 5 repeats per question. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 71.2%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: ITBench-AA (SRE)
Agents · Family index: 91.4 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-itbench-aa
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 0.6 %
- Raw value:
- 51.035781544256096 %
- Metric:
- Average precision at full recall
- Version:
- AA cohort: 59 tasks
- Participating models:
- 36
- Rank percentile within the cohort:
- 91.4 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-itbench-aa:AA cohort: 59 tasks:standalone:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-itbench-aa","AA cohort: 59 tasks","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Harness:
- Artificial Analysis Stirrup
- Agent:
- Stirrup agent
- Tool policy:
- Shell access to an offline Kubernetes incident snapshot
- Attempts:
- Average precision at full recall, 3 repeats per task
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption. 59 Kubernetes incident tasks, 40 public and 19 private, with three repeats per task. A run scores zero if it misses any true root cause; otherwise it receives its precision at full recall. This is the SRE slice of ITBench.. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: Shell access to an offline Kubernetes incident snapshot. Attempts: Average precision at full recall, 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption. 59 Kubernetes incident tasks, 40 public and 19 private, with three repeats per task. A run scores zero if it misses any true root cause; otherwise it receives its precision at full recall. This is the SRE slice of ITBench.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: Shell access to an offline Kubernetes incident snapshot. Attempts: Average precision at full recall, 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 51.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: AA-Omniscience
Knowledge · Family index: 51.2 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-omniscience
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 2.38 %
- Raw value:
- 0.05 points
- Metric:
- AA-Omniscience Index
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 51.2 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-omniscience:unspecified:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-omniscience","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: GPQA Diamond
Reasoning · Family index: 75.0 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 50 %
- Vals AI
Published configurations differ within this cohort.
- Measurement:
- vals-gpqa
- Series weight within the test family:
- 50 %
- Nominal contribution to the overall panel:
- 0.51 %
- Raw value:
- 90.909 %
- Metric:
- accuracy
- Version:
- 1
- Participating models:
- 77
- Rank percentile within the cohort:
- 75.0 %
- Retrieved:
- 2026-10-15
- Comparison cohort:
- vals-gpqa:1:overall
- Reasoning tier:
- xhigh
- Documented comparison setup
- Publication cohort:
- vals-gpqa:1:overall
- Dataset type:
- public
- Setup and model parameters
- Reasoning effort: xhigh. Maximum output tokens: 128000
Source model ID: openai/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-01. Reasoning effort: xhigh. Maximum output tokens: 128000. Latency in seconds: 36.764. Standard error: 1.906. Cost per task in USD: 0.033997. Source ID: vals-ai. Evidence capture ID: vals-gpqa-2026-10-15-951eb5224097. Source payload hash: 951eb5224097733a9d09d06c14908ae2980e2e640e539f2c284877c5092d7077. Parser version: vals-astro-v3. Imported at: 2026-10-15
- Vals AI
Test family: Humanity’s Last Exam
Reasoning · Family index: 76.8 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 50 %
- Artificial Analysis
Published configurations differ within this cohort.
- Measurement:
- artificial-analysis-humanitys-last-exam
- Series weight within the test family:
- 50 %
- Nominal contribution to the overall panel:
- 0.51 %
- Raw value:
- 42.9101019462465 %
- Metric:
- Text-only pass@1 accuracy
- Version:
- unspecified
- Participating models:
- 83
- Rank percentile within the cohort:
- 76.8 %
- Retrieved:
- 2026-10-19
- Comparison cohort:
- artificial-analysis-humanitys-last-exam:unspecified:v4.3.2:reasoning:tokens=0:suffix=Max
- Reasoning tier:
- Max
- Documented comparison setup
- Publication cohort:
- ["artificial-analysis-humanitys-last-exam","unspecified","aa-model-page-2026-10-19-8a022369738c"]
- Dataset type:
- artificial-analysis-evaluation
- Setup and model parameters
- Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Exact AA configuration: GPT-5.6 Terra (Max) (release gpt-5-6-terra, row gpt-5-6-terra, UUID bcf8db0a-3bb6-4d82-9516-0f57370c85a6, reasoning=true, source reasoning-token configuration budget=0, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/bcf8db0a-3bb6-4d82-9516-0f57370c85a6/gpt-5-6-terra/gpt-5-6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: GPT-5.6 Terra (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 42.9%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
- Artificial Analysis
Test family: LMArena Text, Style Control
General · Family index: 41.7 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
- LMArena
Published configurations differ within this cohort.
- Measurement:
- lmarena-text-style-control
- Series weight within the test family:
- 100 %
- Nominal contribution to the overall panel:
- 1.43 %
- Raw value:
- 1,465.8969474060723 rating
- Metric:
- style-controlled Bradley-Terry rating
- Version:
- style-control-v1
- Participating models:
- 37
- Rank percentile within the cohort:
- 41.7 %
- Retrieved:
- 2026-10-15
- Comparison cohort:
- lmarena-text-style-control:2026-10-13:overall
- Reasoning tier:
- xhigh
- Documented comparison setup
- Publication cohort:
- lmarena-text-style-control:2026-10-13:overall
- Dataset type:
- public-crowdsourced-preferences
- Harness:
- Arena Text, style control
- Setup and model parameters
- Arena rating from 42,358 published pairwise votes.. Harness: Arena Text, style control. Reasoning effort: xhigh
Arena rating from 42,358 published pairwise votes.. Source model ID: lmarena/gpt-5.6-terra-xhigh. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Model snapshot: gpt-5.6-terra-xhigh. Evaluator: LMArena. Dataset type: public-crowdsourced-preferences. Leaderboard date: 2026-10-13. Harness: Arena Text, style control. Reasoning effort: xhigh. Source ID: lmarena. Evidence capture ID: lmarena-4589dee83b594891961ae5190c508a9288d2c2ae-a39cbed99996. Source payload hash: a39cbed99996f4993a4cd66d8322b2edb939f1ffdbd377c9d3769edd01dd78ca. Parser version: lmarena-dataset-v1. Imported at: 2026-10-15
- LMArena
Test family: LMArena Vision, Style Control
Multimodal · Family index: 46.7 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: MMMU-Pro
Multimodal · Family index: 73.3 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: SWE-bench Verified
Coding · Family index: 94.1 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: Terminal-Bench
Coding · Family index: 78.5 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 83 %
Test family: Terminal-Bench Science
Coding · Family index: 62.2 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Code Migration
Coding · Family index: 82.3 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: CorpFin v2
Finance · Family index: 73.6 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: CyberBench v1.1
Cybersecurity · Family index: 71.2 / 100Nominal family weight in the overall panel: 7.14 % · Coverage of this test family: 100 %
Test family: EMB
Finance · Family index: 67.8 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Finance Agent (v2)
Finance · Family index: 73.3 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: IOI
Coding · Family index: 84.8 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: LiveCodeBench v6
Coding · Family index: 74.0 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Harvey's Legal Agent Benchmark
Legal · Family index: 27.9 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: LegalBench
Legal · Family index: 76.9 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: Legal Research Bench
Legal · Family index: 70.8 / 100Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: MedCode
Health · Family index: 50.7 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MedScribe
Health · Family index: 48.5 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MMLU-Pro
Knowledge · Family index: 64.9 / 100Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MortgageTax
Finance · Family index: 63.5 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: ProgramBench
Coding · Family index: 60.2 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: ProofBench
Mathematics · Family index: 64.1 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: SAGE
Education · Family index: 55.2 / 100Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: SkillsBench
Agents · Family index: 72.4 / 100Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
Test family: Public Benefits Bench v1.1
Productivity · Family index: 44.7 / 100Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: SRE Bench
General · Family index: 58.3 / 100Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: Tax Agent Bench
Finance · Family index: 65.5 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: TaxEval v2
Finance · Family index: 96.7 / 100Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Vibe Code Bench 1-100
Coding · Family index: 33.3 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Vibe Code Bench v1.1
Coding · Family index: 66.7 / 100Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Benchmark sources at a glance
Each evaluator measures different capabilities under its own conditions. Test series, composite indices and their components stay separate. The detailed results below retain their scales, configurations and source dates.
| Evaluator | Test series | Composite indices | Recorded active measurements |
|---|---|---|---|
| Artificial Analysis | 13 | 1 | 80 |
| Vals AI | 30 | 2 | 217 |
| LMArena | 3 | 0 | 42 |
| LiveBench | 0 | 1 | 8 |
| ARC Prize | 2 | 0 | 8 |
Coverage is not a quality ranking. Overlapping tests and multiple settings do not count as independent experiments. Vendor claims, historical and disputed results are excluded from this overview and remain labelled in the detailed evidence.
Page 1 of 35
Published benchmarks
BrowseComp
Overall
1,266 hard-to-find research tasks with short, unambiguous answers. The benchmark rewards persistent fact finding and only partly represents open-ended research reports or typical user questions.
Note (GPT-5.6 Terra): Editorial selection from the vendor table, not a complete extract of the comparison cohort.
1.Claude Mythos 588%
Note: Editorial selection from the vendor table, not a complete extract of the comparison cohort.
3.Gemini 3.1 Pro Preview85.9%
Note: Editorial selection from the vendor table, not a complete extract of the comparison cohort.
4.GPT-5.584.4%
Note: Editorial selection from the vendor table, not a complete extract of the comparison cohort.
5.Claude Opus 4.884.3%
Note: Editorial selection from the vendor table, not a complete extract of the comparison cohort.
6.GPT-5.6 Luna83.3%
Note: Editorial selection from the vendor table, not a complete extract of the comparison cohort.
higher is betterAs of September 2, 2026Scale: 0% - 100%
Methodology and context
- Comparison cohort
- browsecomp-openai-gpt-5-6-table
- Metric
- accuracy
- Scale
- 0-100
- Participants
- 6
- Methodology and context
- Cross-vendor comparison table with browsing tools. Exact agent systems differ.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: OpenAI. Dataset type: public. Leaderboard date: 2026-07-09. Source ID: openai. Evidence capture ID: curated-openai-2026-09-02-479c1c78025d. Source payload hash: 479c1c78025d3ec6eefa63ab90f161c5c112f808052d1e683d37b370181a45b5. Parser version: curated-v1. Imported at: 2026-10-15
Reasoning
LiveBench
A regularly refreshed mix of objectively scored tasks across seven categories. The composite applies only to the specific release and its weighting.
| Sub-task | GPT-5.6 Terra (This model) | Claude Fable 5 | GPT-5.6 Sol | GPT-5.5 |
|---|---|---|---|---|
| Agentic coding | 54.9 | 62.2 (best value in this row) | 56.2 | 54 |
| Coding | 78.2 | 86 (best value in this row) | 83.9 | 82.1 |
| Data analysis | 79.3 | 80.5 | 79.8 | 81.6 (best value in this row) |
| Overall | 77.94 | 82.97 (best value in this row) | 81.05 | 80.19 |
| Instruction following | 64.6 | 75.8 (best value in this row) | 71.8 | 70.7 |
| Language | 82.9 | 90.7 (best value in this row) | 87.7 | 87.4 |
| Mathematics | 94.9 | 96 | 96.2 (best value in this row) | 95.9 |
| Reasoning | 90.6 | 89.7 | 91.7 (best value in this row) | 89.7 |
Unit: pointshigher is betterAs of September 2, 2026Source: LiveBenchbars scaled within each row, not across rows
Agent tasks
Taste-Bench
Overall
502 technical decision points from engineering and research workflows. Each choice is presented in both answer orders. The overall score averages engineering and research and requires both answer orders to be correct. Unparseable responses count as wrong. Reasoning settings and output budget are part of the setup.
Note (GPT-5.6 Terra): 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
1.GPT-5.6 Sol59.7%
Note: 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
2.GPT-5.559.5%
Note: 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
3.Claude Opus 555.5%
Note: 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
4.Grok 4.554.6%
Note: 10 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
6.GLM-5.253.9%
Note: 17 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
7.Claude Sonnet 551.6%
Note: 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
8.GPT-5.6 Luna49%
Note: 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
9.MiniMax M345.3%
Note: 3 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
10.DeepSeek-V4-Flash43.3%
Note: 2 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
11.GPT-5.4 mini40.1%
Note: 112 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
12.Mistral Medium 3.537.7%
Note: 24 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
13.GPT-5.4 nano36.6%
Note: 93 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
14.Grok 4.20 Reasoning15.7%
Note: 459 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
higher is betterAs of September 26, 2026Scale: 0% - 100%
Methodology and context
- Comparison cohort
- taste-bench-paper-v2-502
- Metric
- both-orders-correct, engineering/research macro average
- Scale
- 0-100
- Participants
- 14
- Methodology and context
- Same prompt for all models. Each of 502 questions is shown twice with the options reversed. Average of engineering and research success rates, requiring both orders to be correct. 65,536-token output budget; unparseable answers count as wrong.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: Taste-Bench paper. Dataset type: public. Leaderboard date: 2026-09-23. Attempts: 502 questions, two option orders each. Reasoning effort: default. Maximum output tokens: 65536. Source ID: taste-bench-paper. Evidence capture ID: curated-taste-bench-paper-2026-09-26-76e7a375c96f. Source payload hash: 76e7a375c96f4c61fc47a503231318beeac777f7848226306fe652468ee6f4d7. Parser version: curated-v1. Imported at: 2026-10-15
Terminal-Bench 4.0
Overall
Agentic evaluation of tasks in reproducible terminal environments. The agent, tools, environment, and reasoning level are part of the result. Scores from older Terminal-Bench versions are not directly comparable.
Note (GPT-5.6 Terra): Selection of exactly identified models from the official 35-row leaderboard. Agents and reasoning efforts differ. These values do not belong to the separate Vals Mini-SWE-agent cohort.
1.GPT-6.1 Sol58.18%
Note: Selection of exactly identified models from the official 35-row leaderboard. Agents and reasoning efforts differ. These values do not belong to the separate Vals Mini-SWE-agent cohort.
2.GPT-5.6 Sol37.27%
Note: Selection of exactly identified models from the official 35-row leaderboard. Agents and reasoning efforts differ. These values do not belong to the separate Vals Mini-SWE-agent cohort.
higher is betterAs of October 15, 2026Scale: 0% - 100%
Methodology and context
- Comparison cohort
- terminal-bench-4-leaderboard-9f966760-00f1-424e-90f5-c964fb6f6091-2026-10-06
- Metric
- trial pass rate
- Scale
- 0-100
- Participants
- 3
- Methodology and context
- 330 graded trials, Codex agent, max reasoning. Dataset version 1922072f-a433-429a-8929-350d5e1bcf02.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: Terminal-Bench. Dataset type: public. Leaderboard date: 2026-10-06. Agent: Codex. Attempts: 330 graded trials. Reasoning effort: max. Source ID: terminal-bench. Evidence capture ID: curated-terminal-bench-2026-10-15-5ee6ef451faa. Source payload hash: 5ee6ef451faa907bc05297ac17656782187d771af787c1b4c879832f64303a60. Parser version: curated-v1. Imported at: 2026-10-15
Recorded measurement details
BrowseComp: Overall (Show measurement, test conditions, and source)
- Source value
- 87.5
- Score
- 87.5
- Metric
- accuracy
- Unit
- %
- Benchmark version
- 1,266 tasks
- Category
- search
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- browsecomp-openai-gpt-5-6-table
- Source type
- vendor-reported
- Evaluator
- OpenAI
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Cross-vendor comparison table with browsing tools. Exact agent systems differ.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: OpenAI. Dataset type: public. Leaderboard date: 2026-07-09. Source ID: openai. Evidence capture ID: curated-openai-2026-09-02-479c1c78025d. Source payload hash: 479c1c78025d3ec6eefa63ab90f161c5c112f808052d1e683d37b370181a45b5. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Cross-vendor comparison table with browsing tools. Exact agent systems differ.
- Context
- Editorial selection from the vendor table, not a complete extract of the comparison cohort.
LiveBench: Agentic coding (Show measurement, test conditions, and source)
- Source value
- 54.9
- Score
- 54.9
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- agentic-coding
- Task label
- Agentic coding
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-agentic-coding-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Agentic coding category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-3599bbcd44b9. Source payload hash: 3599bbcd44b922207599278339a7983e10201ad79a978093a8ddf831ebbc1a69. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Agentic coding category inside the same LiveBench release.
LiveBench: Coding (Show measurement, test conditions, and source)
- Source value
- 78.2
- Score
- 78.2
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- coding
- Task label
- Coding
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-coding-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Coding category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-4f7eb5af41be. Source payload hash: 4f7eb5af41be9c54b2cd089e592c2d6db97e1f114a880fe5db6241f0b32df2d4. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Coding category inside the same LiveBench release.
LiveBench: Data analysis (Show measurement, test conditions, and source)
- Source value
- 79.3
- Score
- 79.3
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- data-analysis
- Task label
- Data analysis
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-data-analysis-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Data analysis category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-c0dbc6eae1dc. Source payload hash: c0dbc6eae1dce9cc995e1760b1b3385b42986409a1af8e0516b10f2371488671. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Data analysis category inside the same LiveBench release.
LiveBench: Overall (Show measurement, test conditions, and source)
- Source value
- 77.94
- Score
- 77.94
- Metric
- composite score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- 23 objectively scored tasks across seven categories.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-9097c2166459. Source payload hash: 9097c2166459af127f6931ba009606101153143f156c2c922603e45209515f00. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- 23 objectively scored tasks across seven categories.
LiveBench: Instruction following (Show measurement, test conditions, and source)
- Source value
- 64.6
- Score
- 64.6
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- instruction-following
- Task label
- Instruction following
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-instruction-following-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Instruction following category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-98691671f5a7. Source payload hash: 98691671f5a7a6df44b6ddd8bffd37d97203df3d564f25c0c325571faffd8dde. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Instruction following category inside the same LiveBench release.
LiveBench: Language (Show measurement, test conditions, and source)
- Source value
- 82.9
- Score
- 82.9
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- language
- Task label
- Language
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-language-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Language category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-f135abd005cf. Source payload hash: f135abd005cf1e2007de3ed34aeeafe888392ab48dd06faaaebb325d2b0e7784. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Language category inside the same LiveBench release.
LiveBench: Mathematics (Show measurement, test conditions, and source)
- Source value
- 94.9
- Score
- 94.9
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- mathematics
- Task label
- Mathematics
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-mathematics-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Mathematics category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-b8cf27594a0a. Source payload hash: b8cf27594a0aab2a4323cad9c23a060391fb93cfe9bfa303dd82768999cfdb4e. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Mathematics category inside the same LiveBench release.
LiveBench: Reasoning (Show measurement, test conditions, and source)
- Source value
- 90.6
- Score
- 90.6
- Metric
- category score
- Unit
- points
- Benchmark version
- 2026-06-25
- Category
- reasoning
- Task
- reasoning
- Task label
- Reasoning
- Direction
- Higher is better
- Comparison cohort
- livebench-2026-06-25-reasoning-max
- Source type
- official-leaderboard
- Evaluator
- LiveBench
- Status
- active
- Retrieved at
- 2026-09-02
- Methodology
- Reasoning category inside the same LiveBench release.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: LiveBench. Dataset type: public. Leaderboard date: 2026-06-25. Source ID: livebench. Evidence capture ID: curated-livebench-2026-09-02-c2884503146e. Source payload hash: c2884503146e9beeb46af3b90af6c0e8e019febb1cf937fb029ca49ad7a027e0. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Reasoning category inside the same LiveBench release.
Taste-Bench: Overall (Show measurement, test conditions, and source)
- Source value
- 54
- Score
- 54
- Metric
- both-orders-correct, engineering/research macro average
- Unit
- %
- Benchmark version
- arxiv:2609.25804v2
- Category
- agentic
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- taste-bench-paper-v2-502
- Source type
- independent-evaluator
- Evaluator
- Taste-Bench paper
- Status
- active
- Retrieved at
- 2026-09-26
- Methodology
- Same prompt for all models. Each of 502 questions is shown twice with the options reversed. Average of engineering and research success rates, requiring both orders to be correct. 65,536-token output budget; unparseable answers count as wrong.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: Taste-Bench paper. Dataset type: public. Leaderboard date: 2026-09-23. Attempts: 502 questions, two option orders each. Reasoning effort: default. Maximum output tokens: 65536. Source ID: taste-bench-paper. Evidence capture ID: curated-taste-bench-paper-2026-09-26-76e7a375c96f. Source payload hash: 76e7a375c96f4c61fc47a503231318beeac777f7848226306fe652468ee6f4d7. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- Same prompt for all models. Each of 502 questions is shown twice with the options reversed. Average of engineering and research success rates, requiring both orders to be correct. 65,536-token output budget; unparseable answers count as wrong.
- Context
- 0 of 1,004 responses were unparseable and counted as wrong. Not a Gradually test.
Terminal-Bench 4.0: Overall (Show measurement, test conditions, and source)
- Source value
- 21.52
- Score
- 21.52
- Metric
- trial pass rate
- Unit
- %
- Benchmark version
- 4.0
- Category
- agentic
- Task
- overall
- Task label
- Overall
- Direction
- Higher is better
- Comparison cohort
- terminal-bench-4-leaderboard-9f966760-00f1-424e-90f5-c964fb6f6091-2026-10-06
- Confidence interval
- 3.25
- Source type
- official-leaderboard
- Evaluator
- Terminal-Bench
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- 330 graded trials, Codex agent, max reasoning. Dataset version 1922072f-a433-429a-8929-350d5e1bcf02.. Source model ID: curated/gpt-5.6-terra. Source model name: GPT-5.6 Terra. Provider reported by source: OpenAI. Evaluator: Terminal-Bench. Dataset type: public. Leaderboard date: 2026-10-06. Agent: Codex. Attempts: 330 graded trials. Reasoning effort: max. Source ID: terminal-bench. Evidence capture ID: curated-terminal-bench-2026-10-15-5ee6ef451faa. Source payload hash: 5ee6ef451faa907bc05297ac17656782187d771af787c1b4c879832f64303a60. Parser version: curated-v1. Imported at: 2026-10-15
- Comparison methodology
- 330 graded trials, Codex agent, max reasoning. Dataset version 1922072f-a433-429a-8929-350d5e1bcf02.
- Context
- Selection of exactly identified models from the official 35-row leaderboard. Agents and reasoning efforts differ. These values do not belong to the separate Vals Mini-SWE-agent cohort.
Page 1 of 35
Our tests
SVG short test
One SVG prompt and fixed output settings. Captures are shown only with 0 reported reasoning tokens or documented lack of reasoning controls. Identical test conditions do not make the models' internal compute identical.
Earlier tests
Pelican on a bicycle
A community classic for free-form SVG drawing.
GPT-5.6 Terra
Reasoning (requested): high
Current attempt
- Run date
- Sep 7, 2026
- API provider
- openrouter
- Requested API model
- openai/gpt-5.6-terra
- API model reported in response
- openai/gpt-5.6-terra
- Reasoning setting
- high
- Pinned endpoint
- OpenAI | openai/gpt-5.6-terra-20260709
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Test protocol
- community-visual-tests-v1
- Technical checks
- Passed, not a quality rating
- Response time
- 64.6 s
Visually reviewed. This individual test does not establish overall model quality.
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)Popularity
64.2 / 100
Specifications and access
| Specification | Value and source |
|---|---|
| Weights | ProprietarySource |
| Access | APISource |
| Context window | 1,050,000 tokensSource |
| Knowledge cutoff | February 16, 2026Source |
| Notes | Balanced tier of the GPT-5.6 family. Generally available from 2026-07-09. Default model for Free and Go users on ChatGPT Work and Codex, effort-selectable on paid tiers. Matches GPT-5.5 quality at roughly half the price ($2.50 input / $15 output per 1M tokens). Terminal-Bench 2.1 82.5%.Source |
| API model ID | gpt-5.6-terraSource |
| Maximum output | 128,000 tokensSource |
| Knowledge cutoff | 2026-02-16Source |
| Input | Text, ImageSource |
| Output | TextSource |
| Reasoning mode | none, low, medium, high, xhigh, maxSource |
| API interfaces | Responses API, Chat Completions APISource |
| Tool calling | YesSource |
| Structured output | YesSource |
| Release | 2026-07-09Source |
Published prices
- API input
- $2 per 1M tokensSource
- API input
- $4 per 1M tokens (above 272,000 context tokens)Source
- API output
- $12 per 1M tokensSource
- API output
- $18 per 1M tokens (above 272,000 context tokens)Source
- Cache write
- $2.5 per 1M tokensSource
- Cache write
- $5 per 1M tokens (above 272,000 context tokens)Source
- Cache read
- $0.2 per 1M tokensSource
- Cache read
- $0.4 per 1M tokens (above 272,000 context tokens)Source