Language modelActive

GPT-4.1

OpenAI

Released: April 14, 2025
Data date: September 8, 2026

Intelligence: Not ranked
Overall score
Speed: 162 tokens/s
Output throughput
Price: $2 · $8
Input · Output / 1M tokens
Input: Text, Image
Output: Text

No published category-wide ranking is available for this model.

Entries 1-12 of 122. Page 1 of 11.

Published benchmarks

Each chart compares models in the same documented test and highlights the current model.

Knowledge

5 measurements

FACTS Benchmark Suite

Document grounding

What this benchmark measures: 3,513 public examples test factuality with documents, images, parametric knowledge, and web search.

Context: The suite score averages four different capabilities. The component scores matter more for decisions.

Higher is better4 modelsGPT-4.1: Rank 4 of 4Data date: August 9, 2026

1.Gemini 2.5 Pro74.2%

2.GPT-569.6%

3.Claude Opus 4.562.1%

4.GPT-4.145.6%

Scale: 0% - 100%

Source: Google DeepMind

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: facts-suite-v2:official:grounding
Metric: accuracy
Scale: 0-100
Participants: 4
Methodology and context: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-0be836d1f39c. Source payload hash: 0be836d1f39c73f658fbd58311b78895cd01e90484a88fcde24677c2f93da643. Parser version: curated-v1. Imported at: 2026-09-04

Source: Google DeepMind

FACTS Benchmark Suite

Multimodal factuality

What this benchmark measures: 3,513 public examples test factuality with documents, images, parametric knowledge, and web search.

Context: The suite score averages four different capabilities. The component scores matter more for decisions.

Higher is better4 modelsGPT-4.1: Rank 3 of 4Data date: August 9, 2026

1.Gemini 2.5 Pro46.9%

2.GPT-544.1%

3.GPT-4.140.1%

4.Claude Opus 4.539.2%

Scale: 0% - 100%

Source: Google DeepMind

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: facts-suite-v2:official:multimodal
Metric: accuracy
Scale: 0-100
Participants: 4
Methodology and context: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-7645fa201934. Source payload hash: 7645fa201934b26e438c483ef045cc1e061b442f830c427ce2ea166175f76212. Parser version: curated-v1. Imported at: 2026-09-04

Source: Google DeepMind

FACTS Benchmark Suite

FACTS overall score

What this benchmark measures: 3,513 public examples test factuality with documents, images, parametric knowledge, and web search.

Context: The suite score averages four different capabilities. The component scores matter more for decisions.

Higher is better4 modelsGPT-4.1: Rank 4 of 4Data date: August 9, 2026

1.Gemini 2.5 Pro62.1%

2.GPT-561.8%

3.Claude Opus 4.551.3%

4.GPT-4.150.5%

Scale: 0% - 100%

Source: Google DeepMind

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: facts-suite-v2:official:overall
Metric: FACTS score
Scale: 0-100
Participants: 4
Methodology and context: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-14261b925a17. Source payload hash: 14261b925a177e14a77999ab9e9644284f0a245197319920c832cbde8c74cbd7. Parser version: curated-v1. Imported at: 2026-09-04

Source: Google DeepMind

FACTS Benchmark Suite

Parametric knowledge

What this benchmark measures: 3,513 public examples test factuality with documents, images, parametric knowledge, and web search.

Context: The suite score averages four different capabilities. The component scores matter more for decisions.

Higher is better4 modelsGPT-4.1: Rank 3 of 4Data date: August 9, 2026

1.Gemini 2.5 Pro63.2%

2.GPT-555.8%

3.GPT-4.151.5%

4.Claude Opus 4.530.6%

Scale: 0% - 100%

Source: Google DeepMind

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: facts-suite-v2:official:parametric
Metric: accuracy
Scale: 0-100
Participants: 4
Methodology and context: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-14b3fb6cdae0. Source payload hash: 14b3fb6cdae04e0c41b377770d9c9bd643a1a7bb433f159ef214d854bc03edea. Parser version: curated-v1. Imported at: 2026-09-04

Source: Google DeepMind

FACTS Benchmark Suite

Factuality with search

What this benchmark measures: 3,513 public examples test factuality with documents, images, parametric knowledge, and web search.

Context: The suite score averages four different capabilities. The component scores matter more for decisions.

Higher is better4 modelsGPT-4.1: Rank 3 of 4Data date: August 9, 2026

1.GPT-577.7%

2.Claude Opus 4.573.2%

3.GPT-4.164.6%

4.Gemini 2.5 Pro63.9%

Scale: 0% - 100%

Source: Google DeepMind

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: facts-suite-v2:official:search
Metric: accuracy
Scale: 0-100
Participants: 4
Methodology and context: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-852a0d7683d0. Source payload hash: 852a0d7683d0a5ab676adff7e03b0b5df6a876c87f23f5a499867dd58a71543f. Parser version: curated-v1. Imported at: 2026-09-04

Source: Google DeepMind

Agent tasks

3 measurements

AssistantBench

Accuracy

What this benchmark measures: 33 automatically verifiable HAL tasks drawn from 214 realistic, time-consuming web research tasks.

Context: The published HAL subset is smaller than the full dataset. Reported costs do not account for caching benefits.

Higher is better4 modelsGPT-4.1: Rank 3 of 4Data date: August 5, 2026

1.o338.81%

2.GPT-535.23%

3.GPT-4.117.39%

4.DeepSeek-V32.03%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-assistantbench-browser-use-overall
Metric: accuracy
Scale: 0-100
Participants: 4
Methodology and context: One shared Browser-Use scaffold solves 33 verified HAL tasks. Total cost is divided by 33.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: Browser-Use. Agent: Browser-Use. Cost per task in USD: 0.4287878787878788. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-317cdcf90f39. Source payload hash: 317cdcf90f39889de796dd5ed97633968cfa6fc40917816c0eff382bcad3b325. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

Online Mind2Web

Accuracy

What this benchmark measures: 300 verified tasks across 136 dynamic live websites.

Context: SeeAct and Browser-Use are different agent scaffolds and therefore remain separate comparison cohorts.

Higher is better5 modelsGPT-4.1: Rank 1 of 5Data date: August 5, 2026

1.GPT-4.136.33%

2.DeepSeek-V332.33%

3.GPT-532%

4.o329%

5.DeepSeek-R125.33%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-online-mind2web-browser-use-overall
Metric: accuracy
Scale: 0-100
Participants: 5
Methodology and context: The Browser-Use scaffold handles the same 300 tasks across 136 live websites. Total cost is divided by 300.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: Browser-Use. Agent: Browser-Use. Cost per task in USD: 0.7887333333333334. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-f727a2342c00. Source payload hash: f727a2342c00533df3b6fb542fd48c0dedb2cf072902596e015182af311abb43. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

Online Mind2Web

Accuracy

What this benchmark measures: 300 verified tasks across 136 dynamic live websites.

Context: SeeAct and Browser-Use are different agent scaffolds and therefore remain separate comparison cohorts.

Higher is better3 modelsGPT-4.1: Rank 3 of 3Data date: August 5, 2026

1.GPT-542.33%

2.o339%

3.GPT-4.130.33%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-online-mind2web-seeact-overall
Metric: accuracy
Scale: 0-100
Participants: 3
Methodology and context: The SeeAct scaffold handles the same 300 tasks across 136 live websites. Total cost is divided by 300.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SeeAct. Agent: SeeAct. Cost per task in USD: 0.9041333333333332. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-074a21a43210. Source payload hash: 074a21a432100e526acf27d64504c04f8a88efa72eebe5dc1a796eb82c544b6b. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

Coding

4 measurements

SciCode

Accuracy

What this benchmark measures: 65 scientific coding problems with 338 subproblems across 16 research fields.

Context: Zero Shot, Tool Calling, and HAL Generalist are not directly comparable scaffolds.

Higher is better2 modelsGPT-4.1: Rank 2 of 2Data date: August 5, 2026

1.o33.08%

2.GPT-4.11.54%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-scicode-hal-generalist-overall
Metric: accuracy
Scale: 0-100
Participants: 2
Methodology and context: HAL Generalist on 65 main scientific problems. Total cost is divided by 65.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: HAL Generalist. Agent: HAL Generalist. Cost per task in USD: 1.1364615384615386. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-bb466275f6c0. Source payload hash: bb466275f6c0c61f66c366f759a33adefcced75e1e24a714abfba0968ba07d84. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

SciCode

Accuracy

What this benchmark measures: 65 scientific coding problems with 338 subproblems across 16 research fields.

Context: Zero Shot, Tool Calling, and HAL Generalist are not directly comparable scaffolds.

Higher is better4 modelsGPT-4.1: Rank 4 of 4Data date: August 5, 2026

1.o39.23%

2.GPT-56.15%

3.Claude Sonnet 4.53.08%

4.GPT-4.11.54%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-scicode-scicode-tool-calling-overall
Metric: accuracy
Scale: 0-100
Participants: 4
Methodology and context: SciCode Tool Calling on 65 main scientific problems. Total cost is divided by 65.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SciCode Tool Calling. Agent: SciCode Tool Calling. Cost per task in USD: 1.0675384615384615. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-8754d9d767b9. Source payload hash: 8754d9d767b9b85166f6161bacf66e86cd2298b0c94fb3b1a160641dfc04932f. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

SciCode

Accuracy

What this benchmark measures: 65 scientific coding problems with 338 subproblems across 16 research fields.

Context: Zero Shot, Tool Calling, and HAL Generalist are not directly comparable scaffolds.

Higher is better3 modelsGPT-4.1: Rank 1 of 3Data date: August 5, 2026

1.GPT-4.16.15%

2.o34.62%

3.DeepSeek-V33.08%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-scicode-scicode-zero-shot-overall
Metric: accuracy
Scale: 0-100
Participants: 3
Methodology and context: SciCode Zero Shot on 65 main scientific problems. Total cost is divided by 65.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SciCode Zero Shot. Agent: SciCode Zero Shot. Cost per task in USD: 0.04338461538461538. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-c289437576ec. Source payload hash: c289437576ecb12a349057214182a22bc55e018a2fea8e98a4284aa3d2cb0f37. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

ScienceAgentBench

Accuracy

What this benchmark measures: 102 expert-validated tasks for data-driven scientific work.

Context: The scaffold, tools, and code execution are part of the result. HAL reports both 42 and 44 underlying publications in different places.

Higher is better5 modelsGPT-4.1: Rank 3 of 5Data date: August 6, 2026

1.o333.33%

2.GPT-530.39%

3.GPT-4.124.51%

4.DeepSeek-R123.53%

5.DeepSeek-V315.69%

Scale: 0% - 100%

Source: Princeton HAL

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: hal-scienceagentbench-sab-self-debug-overall
Metric: accuracy
Scale: 0-100
Participants: 5
Methodology and context: SAB Self-Debug on 102 scientific tasks. Total cost is divided by 102 and excludes caching benefits according to HAL.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SAB Self-Debug. Agent: SAB Self-Debug. Cost per task in USD: 0.07274509803921568. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-06-12f107898c93. Source payload hash: 12f107898c93eeb656847cf8cefab22d2f5c03b4b0236847b3f2af67c76d3bbc. Parser version: curated-v1. Imported at: 2026-09-04

Source: Princeton HAL

Recorded measurement details

Every observation retains its source value and published test conditions.

FACTS Benchmark Suite: Document grounding (Show measurement, test conditions, and source)

Source value: 45.6
Score: 45.6
Metric: accuracy
Unit: %
Benchmark version: FACTS Benchmark Suite v2
Category: knowledge
Task: grounding
Task label: Document grounding
Direction: Higher is better
Comparison cohort: facts-suite-v2:official:grounding
Confidence interval: 2.3
Source type: official-leaderboard
Evaluator: Google DeepMind
Status: active
Retrieved at: 2026-08-09
Methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-0be836d1f39c. Source payload hash: 0be836d1f39c73f658fbd58311b78895cd01e90484a88fcde24677c2f93da643. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.

Source Google DeepMind

FACTS Benchmark Suite: Multimodal factuality (Show measurement, test conditions, and source)

Source value: 40.1
Score: 40.1
Metric: accuracy
Unit: %
Benchmark version: FACTS Benchmark Suite v2
Category: knowledge
Task: multimodal
Task label: Multimodal factuality
Direction: Higher is better
Comparison cohort: facts-suite-v2:official:multimodal
Confidence interval: 3.5
Source type: official-leaderboard
Evaluator: Google DeepMind
Status: active
Retrieved at: 2026-08-09
Methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-7645fa201934. Source payload hash: 7645fa201934b26e438c483ef045cc1e061b442f830c427ce2ea166175f76212. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.

Source Google DeepMind

FACTS Benchmark Suite: FACTS overall score (Show measurement, test conditions, and source)

Source value: 50.5
Score: 50.5
Metric: FACTS score
Unit: %
Benchmark version: FACTS Benchmark Suite v2
Category: knowledge
Task: overall
Task label: FACTS overall score
Direction: Higher is better
Comparison cohort: facts-suite-v2:official:overall
Source type: official-leaderboard
Evaluator: Google DeepMind
Status: active
Retrieved at: 2026-08-09
Methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-14261b925a17. Source payload hash: 14261b925a177e14a77999ab9e9644284f0a245197319920c832cbde8c74cbd7. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.

Source Google DeepMind

FACTS Benchmark Suite: Parametric knowledge (Show measurement, test conditions, and source)

Source value: 51.5
Score: 51.5
Metric: accuracy
Unit: %
Benchmark version: FACTS Benchmark Suite v2
Category: knowledge
Task: parametric
Task label: Parametric knowledge
Direction: Higher is better
Comparison cohort: facts-suite-v2:official:parametric
Confidence interval: 2.1
Source type: official-leaderboard
Evaluator: Google DeepMind
Status: active
Retrieved at: 2026-08-09
Methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-14b3fb6cdae0. Source payload hash: 14b3fb6cdae04e0c41b377770d9c9bd643a1a7bb433f159ef214d854bc03edea. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.

Source Google DeepMind

FACTS Benchmark Suite: Factuality with search (Show measurement, test conditions, and source)

Source value: 64.6
Score: 64.6
Metric: accuracy
Unit: %
Benchmark version: FACTS Benchmark Suite v2
Category: knowledge
Task: search
Task label: Factuality with search
Direction: Higher is better
Comparison cohort: facts-suite-v2:official:search
Confidence interval: 2.2
Source type: official-leaderboard
Evaluator: Google DeepMind
Status: active
Retrieved at: 2026-08-09
Methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Google DeepMind. Dataset type: public. Leaderboard date: 2025-12-11. Source ID: google-deepmind. Evidence capture ID: curated-google-deepmind-2026-08-09-852a0d7683d0. Source payload hash: 852a0d7683d0a5ab676adff7e03b0b5df6a876c87f23f5a499867dd58a71543f. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: Public and private splits. Document, image, parametric knowledge, and standardized web search remain separate.

Source Google DeepMind

AssistantBench: Accuracy (Show measurement, test conditions, and source)

Source value: 17.39
Score: 17.39
Metric: accuracy
Unit: %
Benchmark version: HAL 33-task public set
Category: agentic
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-assistantbench-browser-use-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-05
Methodology: One shared Browser-Use scaffold solves 33 verified HAL tasks. Total cost is divided by 33.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: Browser-Use. Agent: Browser-Use. Cost per task in USD: 0.4287878787878788. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-317cdcf90f39. Source payload hash: 317cdcf90f39889de796dd5ed97633968cfa6fc40917816c0eff382bcad3b325. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: One shared Browser-Use scaffold solves 33 verified HAL tasks. Total cost is divided by 33.

Source Princeton HAL

Online Mind2Web: Accuracy (Show measurement, test conditions, and source)

Source value: 36.33
Score: 36.33
Metric: accuracy
Unit: %
Benchmark version: 300-task live set
Category: agentic
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-online-mind2web-browser-use-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-05
Methodology: The Browser-Use scaffold handles the same 300 tasks across 136 live websites. Total cost is divided by 300.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: Browser-Use. Agent: Browser-Use. Cost per task in USD: 0.7887333333333334. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-f727a2342c00. Source payload hash: f727a2342c00533df3b6fb542fd48c0dedb2cf072902596e015182af311abb43. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: The Browser-Use scaffold handles the same 300 tasks across 136 live websites. Total cost is divided by 300.

Source Princeton HAL

Online Mind2Web: Accuracy (Show measurement, test conditions, and source)

Source value: 30.33
Score: 30.33
Metric: accuracy
Unit: %
Benchmark version: 300-task live set
Category: agentic
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-online-mind2web-seeact-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-05
Methodology: The SeeAct scaffold handles the same 300 tasks across 136 live websites. Total cost is divided by 300.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SeeAct. Agent: SeeAct. Cost per task in USD: 0.9041333333333332. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-074a21a43210. Source payload hash: 074a21a432100e526acf27d64504c04f8a88efa72eebe5dc1a796eb82c544b6b. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: The SeeAct scaffold handles the same 300 tasks across 136 live websites. Total cost is divided by 300.

Source Princeton HAL

SciCode: Accuracy (Show measurement, test conditions, and source)

Source value: 1.54
Score: 1.54
Metric: accuracy
Unit: %
Benchmark version: 65-problem main set
Category: coding
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-scicode-hal-generalist-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-05
Methodology: HAL Generalist on 65 main scientific problems. Total cost is divided by 65.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: HAL Generalist. Agent: HAL Generalist. Cost per task in USD: 1.1364615384615386. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-bb466275f6c0. Source payload hash: bb466275f6c0c61f66c366f759a33adefcced75e1e24a714abfba0968ba07d84. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: HAL Generalist on 65 main scientific problems. Total cost is divided by 65.

Source Princeton HAL

SciCode: Accuracy (Show measurement, test conditions, and source)

Source value: 1.54
Score: 1.54
Metric: accuracy
Unit: %
Benchmark version: 65-problem main set
Category: coding
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-scicode-scicode-tool-calling-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-05
Methodology: SciCode Tool Calling on 65 main scientific problems. Total cost is divided by 65.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SciCode Tool Calling. Agent: SciCode Tool Calling. Cost per task in USD: 1.0675384615384615. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-8754d9d767b9. Source payload hash: 8754d9d767b9b85166f6161bacf66e86cd2298b0c94fb3b1a160641dfc04932f. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: SciCode Tool Calling on 65 main scientific problems. Total cost is divided by 65.

Source Princeton HAL

SciCode: Accuracy (Show measurement, test conditions, and source)

Source value: 6.15
Score: 6.15
Metric: accuracy
Unit: %
Benchmark version: 65-problem main set
Category: coding
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-scicode-scicode-zero-shot-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-05
Methodology: SciCode Zero Shot on 65 main scientific problems. Total cost is divided by 65.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SciCode Zero Shot. Agent: SciCode Zero Shot. Cost per task in USD: 0.04338461538461538. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-05-c289437576ec. Source payload hash: c289437576ecb12a349057214182a22bc55e018a2fea8e98a4284aa3d2cb0f37. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: SciCode Zero Shot on 65 main scientific problems. Total cost is divided by 65.

Source Princeton HAL

ScienceAgentBench: Accuracy (Show measurement, test conditions, and source)

Source value: 24.51
Score: 24.51
Metric: accuracy
Unit: %
Benchmark version: verified 102-task set
Category: coding
Task: overall
Task label: Accuracy
Direction: Higher is better
Comparison cohort: hal-scienceagentbench-sab-self-debug-overall
Source type: independent-evaluator
Evaluator: Princeton HAL
Status: active
Retrieved at: 2026-08-06
Methodology: SAB Self-Debug on 102 scientific tasks. Total cost is divided by 102 and excludes caching benefits according to HAL.. Source model ID: curated/gpt-4.1. Source model name: GPT-4.1. Provider reported by source: OpenAI. Evaluator: Princeton HAL. Dataset type: public. Harness: SAB Self-Debug. Agent: SAB Self-Debug. Cost per task in USD: 0.07274509803921568. Source ID: princeton-hal. Evidence capture ID: curated-princeton-hal-2026-08-06-12f107898c93. Source payload hash: 12f107898c93eeb656847cf8cefab22d2f5c03b4b0236847b3f2af67c76d3bbc. Parser version: curated-v1. Imported at: 2026-09-04
Comparison methodology: SAB Self-Debug on 102 scientific tasks. Total cost is divided by 102 and excludes caching benefits according to HAL.

Source Princeton HAL

Our model tests

Community tests you can inspect

Compare how the models respond to the same prompt. Each test shows the first attempt, with no subsequent fixes to the generated code. These results do not contribute to an overall score.

Pelican on a bicycle

A community classic for free-form SVG drawing.

GPT-4.1

Not tested yet

Prompt and test conditions

Generate an SVG of a pelican riding a bicycle

Token limit including reasoning: 8,192 tokens

Task origin (Simon Willison)

Evidence

Sources and data date

Every statement links to its underlying documentation or leaderboard.

Speed: OpenAI. Output speed after the first streaming chunk, not total response time. Classified as deprecated by Artificial Analysis. Artificial Analysis maintains only the default 10K-input workload there. Retrieved September 8, 2026.
Artificial Analysis Methodology
Price: Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs.
Pricing
Input: Documented modalities. Retrieved September 8, 2026.
Model documentation
Output: Documented modalities. Retrieved September 8, 2026.
Model documentation

Research date September 8, 2026. 3 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.

Open evidence questions and research notes (original wording)

Not found in the inspected sources

parameters-billions. OpenAI API and release pages do not publish parameter counts.

Not found in the inspected sources

independent-benchmarks. Only exact OpenAI appendix columns were used in this artifact.

Model metadata (retrieved September 8, 2026)Source
API pricing (retrieved September 8, 2026)Source
Google DeepMind (retrieved August 9, 2026)Source
Princeton HAL (retrieved August 5, 2026)Source
Princeton HAL (retrieved August 5, 2026)Source
Princeton HAL (retrieved August 5, 2026)Source
Princeton HAL (retrieved August 6, 2026)Source
Princeton HAL (retrieved August 5, 2026)Source
Princeton HAL (retrieved August 6, 2026)Source
MMLU-ProX (retrieved August 9, 2026)Source
Scale AI (retrieved August 26, 2026)Source
Scale AI (retrieved August 26, 2026)Source
Scale AI (retrieved August 26, 2026)Source
Scale AI (retrieved August 26, 2026)Source
Scale AI (retrieved August 26, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Vals AI (retrieved August 11, 2026; September 4, 2026)Source
Artificial Analysis (retrieved September 8, 2026)Source
Speed measurement methodologySource

GPT-4.1

Published benchmarks

Knowledge

FACTS Benchmark Suite

FACTS Benchmark Suite

FACTS Benchmark Suite

FACTS Benchmark Suite

FACTS Benchmark Suite

Agent tasks

AssistantBench

Online Mind2Web

Online Mind2Web

Coding

SciCode

SciCode

SciCode

ScienceAgentBench

Recorded measurement details

Community tests you can inspect

Pelican on a bicycle

Specifications and access

Additional source observations

Published prices

100 API requests

Compare this model

Sources and data date