Code MigrationOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | 36.596 % | | Vals AISource detailsData as of: 09/27/2026 |
CyberBench v1.1OverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is better | 71.012 % | | Vals AISource detailsData as of: 09/27/2026 |
EMBOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | 52.911 % | | Vals AISource detailsData as of: 09/27/2026 |
Finance Agent (v2)OverallTest detailsNo documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is better | 48.349 % | | Vals AISource detailsData as of: 09/27/2026 |
Harvey's Legal Agent BenchmarkOverall · Task fully resolvedTest detailsNo documented difference in the test setupVersion: 1Metric: task resolution rateScoring: Higher is better | | 6.667 % | Vals AISource detailsData as of: 09/27/2026 |
IOIOverallTest detailsNo documented difference in the test setupVersion: 2Metric: accuracyScoring: Higher is better | | 40.278 % | Vals AISource detailsData as of: 09/27/2026 |
Legal Research BenchOverall · All-passTest detailsNo documented difference in the test setupVersion: 1Metric: all-pass rateScoring: Higher is better | 37.981 % | | Vals AISource detailsData as of: 09/27/2026 |
LegalBenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 83.277 % | Vals AISource detailsData as of: 09/27/2026 |
MedCodeOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 41.173 % | Vals AISource detailsData as of: 09/26/2026 |
MedScribeOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 85.5 % | Vals AISource detailsData as of: 09/26/2026 |
ProofBenchOverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is better | 31 % | | Vals AISource detailsData as of: 09/28/2026 |
SAGEOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | 34.967 % | | Vals AISource detailsData as of: 09/26/2026 |
SkillsBenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is betterSettings: Harness: OpenHands | 66.034 % | | Vals AISource detailsData as of: 09/27/2026 |
SRE BenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | | Vals AISource detailsData as of: 09/27/2026 |
Tax Agent BenchOverallTest detailsNo documented difference in the test setupVersion: 1Metric: accuracyScoring: Higher is better | | 62.458 % | Vals AISource detailsData as of: 09/27/2026 |
Terminal-Bench 2.1OverallTest detailsNo documented difference in the test setupVersion: 2.1Metric: accuracyScoring: Higher is better | 67.79 % | | Vals AISource detailsData as of: 09/27/2026 |
Terminal-Bench 4.0OverallTest detailsNo documented difference in the test setupVersion: 4.0Metric: accuracyScoring: Higher is better | 6.566 % | | Vals AISource detailsData as of: 09/27/2026 |
Vals IndexOverallTest detailsNo documented difference in the test setupVersion: 2Metric: weighted index scoreScoring: Higher is better | 51.528 % | | Vals AISource detailsData as of: 09/27/2026 |
Vibe Code Bench v1.1OverallTest detailsNo documented difference in the test setupVersion: 1.1Metric: accuracyScoring: Higher is betterSettings: Harness: OpenHands | 69.002 % | | Vals AISource detailsData as of: 09/27/2026 |