CorpFin v2OverallTest detailsNo documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 61.305 % | | Vals AISource detailsData as of: 08/12/2026 |
GAIA ReliabilityAccuracyTest detailsNo documented difference in the test setupVersion: final leak-cleaned public validation setMetric: exact-match accuracyScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability165 GAIA tasks with repeated runs and perturbations. HAL does not publish cost for this evaluation. | | 62.8 % | Princeton HALSource detailsData as of: 08/06/2026 |
GPQA DiamondOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 79.546 % | | Vals AISource detailsData as of: 09/01/2026 |
LegalBenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 82.837 % | | Vals AISource detailsData as of: 09/27/2026 |
LiveCodeBench v6OverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 75.034 % | | Vals AISource detailsData as of: 09/01/2026 |
MedCodeOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 45.174 % | | Vals AISource detailsData as of: 09/26/2026 |
MedScribeOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 83.246 % | | Vals AISource detailsData as of: 09/26/2026 |
MMLU-ProOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 85.59 % | | Vals AISource detailsData as of: 09/01/2026 |
MMMU-ProOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 81.098 % | | Vals AISource detailsData as of: 09/01/2026 |
MortgageTaxOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 68.68 % | | Vals AISource detailsData as of: 09/01/2026 |
SAGEOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 45.002 % | | Vals AISource detailsData as of: 09/26/2026 |
TaxEval v2OverallTest detailsNo documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 74.325 % | | Vals AISource detailsData as of: 09/01/2026 |
Terminal-Bench 2.0OverallTest detailsNo documented difference in the test setupVersion: 2.0Metric: accuracyScoring: Higher is betterClaude Opus 4.5: Snapshot: claude-opus-4-5-20251101 | 58.427 % | | Vals AISource detailsData as of: 06/04/2026 |
τ-bench Airline CleanAccuracyTest detailsNo documented difference in the test setupVersion: 26-task cleaned subsetMetric: task success rateScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability26 cleaned airline tasks. Princeton HAL recomputed every metric from scratch on this subset. | | 79.5 % | Princeton HALSource detailsData as of: 08/05/2026 |
GAIA ReliabilityConsistencyTest detailsNo documented difference in the test setupVersion: final leak-cleaned public validation setMetric: aggregate consistencyScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability165 GAIA tasks with repeated runs and perturbations. HAL does not publish cost for this evaluation. | | 0.61 rating points | Princeton HALSource detailsData as of: 08/06/2026 |
τ-bench Airline CleanConsistencyTest detailsNo documented difference in the test setupVersion: 26-task cleaned subsetMetric: aggregate consistencyScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability26 cleaned airline tasks. Princeton HAL recomputed every metric from scratch on this subset. | | | Princeton HALSource detailsData as of: 08/05/2026 |
GAIA ReliabilityPredictabilityTest detailsNo documented difference in the test setupVersion: final leak-cleaned public validation setMetric: aggregate predictabilityScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability165 GAIA tasks with repeated runs and perturbations. HAL does not publish cost for this evaluation. | | 0.8 rating points | Princeton HALSource detailsData as of: 08/06/2026 |
τ-bench Airline CleanPredictabilityTest detailsNo documented difference in the test setupVersion: 26-task cleaned subsetMetric: aggregate predictabilityScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability26 cleaned airline tasks. Princeton HAL recomputed every metric from scratch on this subset. | | 0.84 rating points | Princeton HALSource detailsData as of: 08/05/2026 |
GAIA ReliabilityReliabilityTest detailsNo documented difference in the test setupVersion: final leak-cleaned public validation setMetric: aggregate reliabilityScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability165 GAIA tasks with repeated runs and perturbations. HAL does not publish cost for this evaluation. | | 0.79 rating points | Princeton HALSource detailsData as of: 08/06/2026 |
τ-bench Airline CleanReliabilityTest detailsNo documented difference in the test setupVersion: 26-task cleaned subsetMetric: aggregate reliabilityScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability26 cleaned airline tasks. Princeton HAL recomputed every metric from scratch on this subset. | 0.88 rating points | | Princeton HALSource detailsData as of: 08/05/2026 |
GAIA ReliabilityRobustnessTest detailsNo documented difference in the test setupVersion: final leak-cleaned public validation setMetric: aggregate robustnessScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability165 GAIA tasks with repeated runs and perturbations. HAL does not publish cost for this evaluation. | 0.91 rating points | | Princeton HALSource detailsData as of: 08/06/2026 |
τ-bench Airline CleanRobustnessTest detailsNo documented difference in the test setupVersion: 26-task cleaned subsetMetric: aggregate robustnessScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability26 cleaned airline tasks. Princeton HAL recomputed every metric from scratch on this subset. | | | Princeton HALSource detailsData as of: 08/05/2026 |
GAIA ReliabilitySafetyTest detailsNo documented difference in the test setupVersion: final leak-cleaned public validation setMetric: aggregate safetyScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability165 GAIA tasks with repeated runs and perturbations. HAL does not publish cost for this evaluation. | | | Princeton HALSource detailsData as of: 08/06/2026 |
τ-bench Airline CleanSafetyTest detailsNo documented difference in the test setupVersion: 26-task cleaned subsetMetric: aggregate safetyScoring: Higher is betterSettings: Agent: HAL Reliability, Harness: HAL Reliability26 cleaned airline tasks. Princeton HAL recomputed every metric from scratch on this subset. | | 0.96 rating points | Princeton HALSource detailsData as of: 08/05/2026 |