BioMysteryBenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Harness: Terminus 2 | | | Vals AISource detailsData as of: 09/27/2026 |
Code MigrationOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 57.473 % | Vals AISource detailsData as of: 09/27/2026 |
CUA-benchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Harness: claude-code | | 9 % | Vals AISource detailsData as of: 09/22/2026 |
CyberBench v1.1OverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is better | 55.357 % | | Vals AISource detailsData as of: 09/27/2026 |
EMBOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 73.556 % | Vals AISource detailsData as of: 09/27/2026 |
Finance Agent (v2)OverallTest detailsNo documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is better | 58.587 % | | Vals AISource detailsData as of: 09/27/2026 |
Harvey's Legal Agent BenchmarkOverall · Task fully resolvedTest detailsNo documented difference in the test setupVersion: 1Metric: task resolution rateScoring: Higher is better | 3.75 % | | Vals AISource detailsData as of: 09/27/2026 |
IOIOverallTest detailsNo documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is better | | 84.333 % | Vals AISource detailsData as of: 09/27/2026 |
Legal Research BenchOverall · All-passTest detailsNo documented difference in the test setupVersion: 1Metric: all-pass rateScoring: Higher is better | 50.481 % | | Vals AISource detailsData as of: 09/27/2026 |
MedCodeOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | 49.797 % | | Vals AISource detailsData as of: 09/26/2026 |
MedScribeOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 90.985 % | Vals AISource detailsData as of: 09/26/2026 |
MysteryMechanismOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 37.387 % | Vals AISource detailsData as of: 09/27/2026 |
ProgramBenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 3 % | Vals AISource detailsData as of: 09/27/2026 |
ProofBenchOverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is better | | 99 % | Vals AISource detailsData as of: 09/28/2026 |
Public Benefits Bench v1.1OverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is better | 70.636 % | | Vals AISource detailsData as of: 09/27/2026 |
SAGEOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | 45.831 % | | Vals AISource detailsData as of: 09/26/2026 |
SRE BenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 12.214 % | Vals AISource detailsData as of: 09/27/2026 |
Tax Agent BenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | 70.499 % | | Vals AISource detailsData as of: 09/27/2026 |
Terminal-Bench 2.1OverallTest detailsNo documented difference in the test setupVersion: 2.1Metric: accuracyScoring: Higher is better | | 84.644 % | Vals AISource detailsData as of: 09/27/2026 |
Terminal-Bench 4.0OverallTest detailsNo documented difference in the test setupVersion: 4.0Metric: accuracyScoring: Higher is better | | 45.455 % | Vals AISource detailsData as of: 09/27/2026 |
Terminal-Bench ScienceOverallTest detailsNo documented difference in the test setupVersion: 0.1Metric: accuracyScoring: Higher is better | | 22.857 % | Vals AISource detailsData as of: 09/27/2026 |
Vals IndexOverallTest detailsNo documented difference in the test setupVersion: 2Metric: weighted index scoreScoring: Higher is better | | 67.213 % | Vals AISource detailsData as of: 09/27/2026 |
Vibe Code Bench 1-100OverallTest detailsNo documented difference in the test setupVersion: 1.0Metric: accuracyScoring: Higher is betterSettings: Harness: OpenHands | | 28.533 % | Vals AISource detailsData as of: 09/22/2026 |
Vibe Code Bench v1.1OverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is betterSettings: Harness: OpenHands | | 88.404 % | Vals AISource detailsData as of: 09/27/2026 |