GPT-6.1 Terravs.Qwen 3.8 27B
Which one is better?
GPT-6.1 Terra is clearly ahead in the overall index, but costs 25 times (input) and 2 times (output) as much per token.
67
GPT-6.1 Terra
Rank 12 to 27
11
Qwen 3.8 27B
Rank 44 to 57
91
GPT-6.1 Terra
fairly slow
40
Qwen 3.8 27B
slow
$2
GPT-6.1 Terra
fairly expensive
$0.66
Qwen 3.8 27B
fairly cheap
GPT-6.1 Terra
- Subscription
Subscriptions in Germany: n/a
- Via API
$1 input, $5 output per 1M tokens.
Qwen 3.8 27B
- Subscription
No Alibaba subscription includes this model. Through other providers from ≈ €1.06 a month (Command Code Go, with limited credits). 10 plans in Germany.
- Via API
$0.04 input, $2.50 output per 1M tokens according to the provider; the price index has listed it at $0.42 and $3 since Oct 27, 2026.
Overall index with data through Oct 29, 2026 · Prices from Oct 29, 2026 · Speed: measured by Artificial Analysis · Subscriptions as of Oct 24, 2026 · Subscription prices incl. VAT
Where is the difference?
Values from 0 to 100 per task area. We only name a winner when the gap is large enough and there are enough tests.
GPT-6.1 Terra ahead: 5Qwen 3.8 27B ahead: 0level: 2too little data: 2of 9 areas
AreaGPT-6.1 TerraQwen 3.8 27B0 to 100, higher is betterResult
Areas in the overall index
CodingGPT-6.1 Terra aheadGPT-6.1 Terra: 84Qwen 3.8 27B: 13
ReasoningGPT-6.1 Terra aheadGPT-6.1 Terra: 88Qwen 3.8 27B: 6
Mathematicsonly Qwen 3.8 27B has a scoreGPT-6.1 Terra: not enough dataQwen 3.8 27B: 8
KnowledgeGPT-6.1 Terra aheadGPT-6.1 Terra: 80Qwen 3.8 27B: 5
AgentsGPT-6.1 Terra aheadGPT-6.1 Terra: 57Qwen 3.8 27B: 21
MultimodalGPT-6.1 Terra aheadGPT-6.1 Terra: 70Qwen 3.8 27B: 13
Specialist fields
FinancelevelGPT-6.1 Terra: 45Qwen 3.8 27B: 34
LegallevelGPT-6.1 Terra: 8Qwen 3.8 27B: 23
Healthonly Qwen 3.8 27B has a scoreGPT-6.1 Terra: not enough dataQwen 3.8 27B: 3
Show 1 more areas that do not count toward the overall index
AreaGPT-6.1 TerraQwen 3.8 27B0 to 100, higher is betterResult
Cybersecurityonly Qwen 3.8 27B has a scoreGPT-6.1 Terra: not enough dataQwen 3.8 27B: 19
See for yourself: same task, one attempt
The same prompt for both models. We show the latest attempt without fixes; it does not count toward the overall index.
This is the lowest documented setting for each provider. It does not make compute comparable across models.
Pelican on a bicycle
A community classic for free-form SVG drawing.
GPT-6.1 Terra
Not tested yet
Qwen 3.8 27B
The response reached the token limit. No complete recording is available.
Reasoning (requested): disabled (enabled: false)
Current attempt
- Run date
- Oct 11, 2026
- API provider
- Alibaba
- Requested API model
- qwen/qwen3.8-27b
- API model reported in response
- qwen/qwen3.8-27b
- Reasoning setting
- disabled (enabled: false)
- Pinned endpoint
- Alibaba | qwen/qwen3.8-27b-20260814
- Temperature
- Provider default
- Token limit including reasoning
- 8,192 tokens
- Reasoning tokens
- 0
- Test protocol
- community-visual-low-v1
- Technical checks
- Failed
- Response time
- 119.1 s
Not yet visually reviewed. A successful recording does not confirm correct physics or full compliance with the prompt.
Prompt and test conditions
Generate an SVG of a pelican riding a bicycle
Token limit including reasoning: 8,192 tokens
Task origin (Simon Willison)SVG short test
There is no shared test round for this selection. Results from different rounds are not mixed.
All data side by side
The better value is bold. For the overall index only when the gap is clear.
| Metric | GPT-6.1 Terra | Qwen 3.8 27B |
|---|---|---|
| Intelligence | ||
| Overall index0 to 100, higher is better | 67 | 11 |
| Rank | Rank 12 to 27 of 95 | Rank 44 to 57 of 95 |
| Price per 1M tokens | ||
| Inputwhat you send | $1above 272,000 tokens: $2 | $0.04 |
| Outputwhat the model writes | $5above 272,000 tokens: $7.50 | $2.50 |
| Speed | ||
| Tokens per second | 91 | 40 |
| Technical | ||
| Context windowhow much text the model reads at once | 1.05 M tokens≈ 1,580 A4 pages | 262,144 tokens≈ 390 A4 pages |
| Knowledge cutoff | Jun 1, 2026 | n/a |
| Released | Oct 26, 2026 | Aug 14, 2026 |
| Availability | Active | Active |
| Open weights | no | yes |
- GPT-6.1 Terra, 12-hour cache write: The table's cache-write rate covers 30-minute retention. With 12-hour retention it is $2.50 per 1M tokens through 272,000 input tokens, $5 above. Source
- GPT-6.1 Terra, Long-context billing: Above 272,000 input tokens, the higher rates apply to the entire request. Input and cache rates double, while output costs 1.5 times the standard rate. Source
- GPT-6.1 Terra, Batch and Flex pricing: 50% off standard pricing Source
- GPT-6.1 Terra, Fast pricing: Fast mode costs twice the standard price Source
- GPT-6.1 Terra, Regional processing: 10% surcharge over standard processing Source
Prices without caching or batch discounts · Page count as a rule of thumb from Artificial Analysis
Shared benchmarks
Single results from the same benchmark version, task and metric. A value is bold only with the same test setup and a clear gap.
A: GPT-6.1 TerraB: Qwen 3.8 27B
AA-BriefcaseOverall · higher is betterGPT-6.1 Terra: 1,332.9 eloQwen 3.8 27B: 1,392.67 eloArtificial AnalysisAs of 10/29/2026
AA-OmniscienceOverall · higher is betterGPT-6.1 Terra: 28.933 pointsQwen 3.8 27B: -6.367 pointsArtificial AnalysisAs of 10/29/2026
AA-Omniscience AccuracyOverall · higher is betterGPT-6.1 Terra: 40.7%Qwen 3.8 27B: 9.1%Artificial AnalysisAs of 10/29/2026
AA-Omniscience Hallucination RateOverall · lower is betterGPT-6.1 Terra: 77.1%Qwen 3.8 27B: 18.0%Artificial AnalysisAs of 10/29/2026
Artificial Analysis Intelligence IndexOverall · higher is betterGPT-6.1 Terra: 44.95 pointsQwen 3.8 27B: 20.107 pointsArtificial AnalysisAs of 10/29/2026
AutomationBench-AAOverall · higher is betterGPT-6.1 Terra: 59.9%Qwen 3.8 27B: 48.2%Artificial AnalysisAs of 10/29/2026
CritPt v2Overall · higher is betterGPT-6.1 Terra: 4.9%Qwen 3.8 27B: 0.3%Artificial AnalysisAs of 10/29/2026
CritPt v2 (Hard Subset)Overall · higher is betterGPT-6.1 Terra: 57.5%Qwen 3.8 27B: 4.0%Artificial AnalysisAs of 10/29/2026
FrontierCodeOverall · higher is betterGPT-6.1 Terra: 36.9%Qwen 3.8 27B: 14.9%Artificial AnalysisAs of 10/29/2026
FrontierCode 1.1 MainOverall · higher is betterGPT-6.1 Terra: 41.0%Qwen 3.8 27B: 7.9%Artificial AnalysisAs of 10/29/2026
Show 54 more benchmarks
GDP.pdfOverall · higher is betterGPT-6.1 Terra: 26.6%Qwen 3.8 27B: 16.4%Artificial AnalysisAs of 10/29/2026
GDPval-AAOverall · higher is betterGPT-6.1 Terra: 1,286.51 eloQwen 3.8 27B: 1,082.47 eloArtificial AnalysisAs of 10/29/2026
HLE-DiamondOverall · higher is betterGPT-6.1 Terra: 42.3%Qwen 3.8 27B: 15.3%Artificial AnalysisAs of 10/29/2026
Legal Research BenchOverall · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 26%Qwen 3.8 27B: 36.1%Vals AIAs of 10/26/2026
MMMU-ProOverall · higher is betterGPT-6.1 Terra: 76.0%Qwen 3.8 27B: 69.9%Artificial AnalysisAs of 10/29/2026
Tax Agent BenchOverall · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 15.2%Qwen 3.8 27B: 30.9%Vals AIAs of 10/26/2026
Terminal-BenchOverall · higher is betterGPT-6.1 Terra: 46.5%Qwen 3.8 27B: 5.6%Artificial AnalysisAs of 10/29/2026
Terminal-Bench-ScienceOverall · higher is betterGPT-6.1 Terra: 41.9%Qwen 3.8 27B: 0.5%Artificial AnalysisAs of 10/29/2026
Vibe Code Bench v1.1Overall · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 84%Qwen 3.8 27B: 64.9%Vals AIAs of 10/26/2026
AA-Omniscience AccuracyOverall · higher is betterGPT-6.1 Terra: 47.4%Qwen 3.8 27B: 17.9%Artificial AnalysisAs of 10/29/2026
AA-Omniscience Hallucination RateOverall · lower is betterGPT-6.1 Terra: 39.6%Qwen 3.8 27B: 65.4%Artificial AnalysisAs of 10/29/2026
CritPt v2Overall · higher is betterGPT-6.1 Terra: 21.4%Qwen 3.8 27B: 0.0%Artificial AnalysisAs of 10/29/2026
FrontierCode 1.1 MainOverall · higher is betterGPT-6.1 Terra: 43.7%Qwen 3.8 27B: 34.7%Artificial AnalysisAs of 10/29/2026
GDPval-AAOverall · higher is betterGPT-6.1 Terra: 1,325.12 eloQwen 3.8 27B: 1,389.29 eloArtificial AnalysisAs of 10/29/2026
Legal Research BenchAdministrative / Regulatory · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 45.5%Qwen 3.8 27B: 45.5%Vals AIAs of 10/26/2026
MMMU-ProOverall · higher is betterGPT-6.1 Terra: 82.8%Qwen 3.8 27B: 74.2%Artificial AnalysisAs of 10/29/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 5.9%Qwen 3.8 27B: 6.7%Vals AIAs of 10/26/2026
AA-Omniscience AccuracyOverall · higher is betterGPT-6.1 Terra: 45.6%Qwen 3.8 27B: 18.3%Artificial AnalysisAs of 10/29/2026
AA-Omniscience Hallucination RateOverall · lower is betterGPT-6.1 Terra: 41.6%Qwen 3.8 27B: 48.7%Artificial AnalysisAs of 10/29/2026
CritPt v2Overall · higher is betterGPT-6.1 Terra: 15.1%Qwen 3.8 27B: 0.0%Artificial AnalysisAs of 10/29/2026
FrontierCode 1.1 MainOverall · higher is betterGPT-6.1 Terra: 36.3%Qwen 3.8 27B: 28.9%Artificial AnalysisAs of 10/29/2026
GDPval-AAOverall · higher is betterGPT-6.1 Terra: 1,204.16 eloQwen 3.8 27B: 1,370.88 eloArtificial AnalysisAs of 10/29/2026
Legal Research BenchAdministrative / Regulatory · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 84.8%Qwen 3.8 27B: 88.5%Vals AIAs of 10/26/2026
MMMU-ProOverall · higher is betterGPT-6.1 Terra: 82.5%Qwen 3.8 27B: 73.8%Artificial AnalysisAs of 10/29/2026
Tax Agent BenchControversy & Precedence Analysis · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 42.5%Qwen 3.8 27B: 48.3%Vals AIAs of 10/26/2026
AA-Omniscience AccuracyOverall · higher is betterGPT-6.1 Terra: 48.0%Qwen 3.8 27B: 17.3%Artificial AnalysisAs of 10/29/2026
AA-Omniscience Hallucination RateOverall · lower is betterGPT-6.1 Terra: 36.8%Qwen 3.8 27B: 28.6%Artificial AnalysisAs of 10/29/2026
CritPt v2Overall · higher is betterGPT-6.1 Terra: 26.6%Qwen 3.8 27B: 5.4%Artificial AnalysisAs of 10/29/2026
FrontierCode 1.1 MainOverall · higher is betterGPT-6.1 Terra: 41.4%Qwen 3.8 27B: 34.2%Artificial AnalysisAs of 10/29/2026
GDPval-AAOverall · higher is betterGPT-6.1 Terra: 1,415.29 eloQwen 3.8 27B: 1,427.26 eloArtificial AnalysisAs of 10/29/2026
Legal Research BenchBusiness & Commercial · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 16.3%Qwen 3.8 27B: 41.9%Vals AIAs of 10/26/2026
MMMU-ProOverall · higher is betterGPT-6.1 Terra: 83.8%Qwen 3.8 27B: 76.3%Artificial AnalysisAs of 10/29/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 22.1%Qwen 3.8 27B: 43.1%Vals AIAs of 10/26/2026
Legal Research BenchBusiness & Commercial · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 75.9%Qwen 3.8 27B: 86.8%Vals AIAs of 10/26/2026
Tax Agent BenchCurrent & Temporal Analysis · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 53.1%Qwen 3.8 27B: 58.6%Vals AIAs of 10/26/2026
Legal Research BenchCivil Litigation · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 14.8%Qwen 3.8 27B: 25.9%Vals AIAs of 10/26/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 16.1%Qwen 3.8 27B: 34.9%Vals AIAs of 10/26/2026
Legal Research BenchCivil Litigation · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 80.6%Qwen 3.8 27B: 83.1%Vals AIAs of 10/26/2026
Tax Agent BenchFact-Pattern Analysis · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 47.2%Qwen 3.8 27B: 57.7%Vals AIAs of 10/26/2026
Legal Research BenchConstitutional / Civil Rights · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 23.7%Qwen 3.8 27B: 26.3%Vals AIAs of 10/26/2026
Tax Agent BenchForms & Filings · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 12.6%Qwen 3.8 27B: 16.7%Vals AIAs of 10/26/2026
Legal Research BenchConstitutional / Civil Rights · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 78%Qwen 3.8 27B: 82%Vals AIAs of 10/26/2026
Tax Agent BenchForms & Filings · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 51.7%Qwen 3.8 27B: 62.4%Vals AIAs of 10/26/2026
Legal Research BenchCriminal · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 17.5%Qwen 3.8 27B: 26.3%Vals AIAs of 10/26/2026
Tax Agent BenchNumbers & Calculations · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 19.1%Qwen 3.8 27B: 32.3%Vals AIAs of 10/26/2026
Legal Research BenchCriminal · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 76.2%Qwen 3.8 27B: 79.6%Vals AIAs of 10/26/2026
Tax Agent BenchNumbers & Calculations · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 63.9%Qwen 3.8 27B: 66.2%Vals AIAs of 10/26/2026
Legal Research BenchFamily · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 4.5%Qwen 3.8 27B: 22.7%Vals AIAs of 10/26/2026
Tax Agent BenchRule & Source Lookup · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 14.9%Qwen 3.8 27B: 50%Vals AIAs of 10/26/2026
Legal Research BenchFamily · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 64.8%Qwen 3.8 27B: 69.2%Vals AIAs of 10/26/2026
Tax Agent BenchRule & Source Lookup · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 40.9%Qwen 3.8 27B: 68%Vals AIAs of 10/26/2026
Legal Research BenchHealth · All-pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 56.7%Qwen 3.8 27B: 63.3%Vals AIAs of 10/26/2026
Tax Agent BenchWeighted Pass · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 49.7%Qwen 3.8 27B: 60%Vals AIAs of 10/26/2026
Legal Research BenchHealth · Weighted partial credit · higher is betterTest setup not documented as identicalGPT-6.1 Terra: 92.8%Qwen 3.8 27B: 94.3%Vals AIAs of 10/26/2026
Compare another matchup
More matchups
Related LLM comparisons
Compare GPT-6.1 Terra and Qwen 3.8 27B with other leading models.