Comparison cohort: vals-biomysterybench:1:overall
Metric: accuracy
Scale: 0-100
Participants: 15
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-27. Harness: Terminus 2. Latency in seconds: 1086.061. Cost per task in USD: 3.736494. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-09-29-ae8417ff089d. Source payload hash: ae8417ff089d100a7fe142b979f417441381dcedfb13f35f1e2a2f4d06f31aec. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

MysteryMechanism

Overall

1.GPT-6 Astra53.15%

2.Claude Opus 5.549.55%

3.Claude Sonnet 5.549.1%

4.Claude Fable 5.147.75%

5.Claude Opus 537.39%

6.Gemini 3.8 Flash36.49%

7.GPT-5.6 Sol33.33%

8.Grok 4.630.63%

9.GPT-6 Sol30.18%

10.Grok 4.725.23%

11.Qwen 3.8 Max 090223.87%

12.GLM-5.322.97%

13.DeepSeek-V4.1-Flash21.17%

14.Gemini 3.1 Pro Preview20.72%

15.GPT-6 Luna19.37%

16.GPT-5.6 Luna14.41%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-mysterymechanism:1:overall
Metric: accuracy
Scale: 0-100
Participants: 16
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 1410.236. Cost per task in USD: 3.45323. Source ID: vals-ai. Evidence capture ID: vals-mysterymechanism-2026-09-29-258cfbb1bd2e. Source payload hash: 258cfbb1bd2e39fcae6d5a1181c9808368bbc3987691d3d1b32b5d193fc465a7. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Coding

Code Migration

Overall

1.Claude Sonnet 5.569.83%

2.GPT-6 Astra67.74%

3.Claude Opus 5.566.65%

4.Claude Opus 557.47%

5.GPT-6 Sol57.2%

6.Claude Fable 555.07%

7.Claude Fable 5.154.61%

8.GPT-5.6 Sol52.92%

9.GPT-5.6 Terra47.8%

10.Claude Opus 4.847.25%

11.DeepSeek-V4.1-Flash45.62%

12.GPT-5.545.16%

13.Grok 4.744.82%

14.Grok 4.644.57%

15.GPT-5.6 Luna44.55%

16.Claude Sonnet 544.39%

17.GLM-5.344.22%

18.Claude Opus 4.743.88%

19.GPT-6 Luna42.55%

20.Claude Sonnet 4.639.89%

21.GLM-5.237.87%

22.Grok 4.536.6%

23.Gemini 3.8 Flash36.55%

24.GPT-5.434.98%

25.Gemini 3.7 Flash34.8%

26.Gemini 3.6 Flash30.93%

27.Kimi K2.627.77%

28.Gemini 3.5 Flash26.75%

29.DeepSeek-V4-Pro26.2%

30.GLM-5.125.77%

31.Kimi K2.7 Code25.39%

32.Qwen 3.8 Max 090223.96%

33.MiMo-V2.5-Pro21.56%

34.GLM-5.3-Flash20.52%

35.MiniMax M319.93%

36.Gemini 3.1 Pro Preview17.31%

37.Kimi K316.1%

38.GPT-5.4 nano14.47%

39.MiMo-V2.514.23%

40.Qwen 3.8 27B14.16%

41.Inkling Small13.68%

42.Qwen 3.7 Max13.07%

43.GPT-5.4 mini12.94%

44.Qwen 3.7 Plus12.86%

45.Inkling11.79%

46.MiniMax M2.78.69%

47.Kimi K2.56.96%

48.Grok 4.36.8%

49.Gemini 3 Flash Preview6.39%

50.Gemini 3.5 Flash-Lite6.15%

51.Mistral Medium 3.55.13%

52.Nemotron 3 Ultra4.91%

53.Gemini 3.1 Flash-Lite4.61%

54.Nemotron 3.5 Lightning2.95%

55.Grok 4.20 Reasoning0.31%

56.Ling 3.0 Flash0%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-code-migration:1:overall
Metric: accuracy
Scale: 0-100
Participants: 56
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 12004.483. Cost per task in USD: 75.826721. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-09-29-f0b317d5bed3. Source payload hash: f0b317d5bed3a2654a9ea39762d5e57f4649306adce3e6103e845ee1b9b94add. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

IOI

Overall

1.GPT-6 Astra100%

2.Claude Opus 5.595.06%

3.GPT-5.6 Sol91.17%

4.Claude Fable 5.190.78%

5.GPT-5.6 Terra87.61%

6.Claude Opus 584.33%

7.Claude Sonnet 5.583.06%

8.GPT-6 Sol82.61%

9.Qwen 3.8 Max 090268.89%

10.GLM-5.368.44%

11.Gemini 3.7 Flash67.83%

12.GPT-5.6 Luna61.78%

13.Grok 4.757.72%

14.Gemini 3.8 Flash56.94%

15.GPT-6 Luna55.56%

16.GPT-5.3-Codex53.83%

17.GLM-5.3-Flash52.5%

18.Gemini 3.1 Pro Preview51.83%

19.Kimi K348.94%

20.Grok 4.647.61%

21.Claude Sonnet 545%

22.Grok 4.540.56%

23.DeepSeek-V4.1-Flash40.28%

24.Qwen 3.8 27B39.06%

25.Gemini 3.6 Flash35.06%

26.Inkling14.94%

27.Inkling Small9.33%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-ioi:2:overall
Metric: accuracy
Scale: 0-100
Participants: 27
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-27. Latency in seconds: 2751.084. Cost per task in USD: 7.524252. Source ID: vals-ai. Evidence capture ID: vals-ioi-2026-09-29-14c4f2dcc872. Source payload hash: 14c4f2dcc872d5e07bce234aebe4932202931d7f5b05f9bcd02e7695b5664750. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

CyberBench v1.1

Overall

1.GPT-6 Sol77.98%

2.GPT-5.6 Sol76.31%

3.GPT-6 Luna76.25%

4.Kimi K375.24%

5.DeepSeek-V4.1-Flash73.69%

6.GPT-5.6 Luna73.63%

7.GLM-5.372.08%

7.GPT-5.6 Terra72.08%

9.Grok 4.571.01%

10.Claude Fable 5.170.42%

11.Grok 4.769.46%

12.GLM-5.3-Flash67.86%

13.Qwen 3.8 27B67.8%

14.Grok 4.667.68%

15.Inkling66.79%

16.Claude Opus 565.36%

17.MiniMax M365%

18.Inkling Small64.11%

19.Claude Sonnet 561.91%

20.Claude Sonnet 5.559.58%

21.Gemini 3.5 Flash-Lite59.11%

22.Claude Opus 5.555.36%

23.Gemini 3.6 Flash45.36%

24.Gemini 3.7 Flash43.75%

24.Gemini 3.8 Flash43.75%

26.GPT-6 Astra41.07%

27.Nemotron 3.5 Lightning29.46%

28.Qwen 3.8 Max 090228.57%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-cyberbench:1.1:overall
Metric: accuracy
Scale: 0-100
Participants: 28
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 2032.625. Cost per task in USD: 4.417372. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-09-29-36ddb5f67bc8. Source payload hash: 36ddb5f67bc8725a7ff9d1cc1349f89d29e0e907ad313eb5ac277b42b3d275e1. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Finance

EMB

Overall

1.Claude Fable 5.176.67%

2.Claude Opus 5.575.94%

3.Claude Sonnet 5.575.71%

4.Claude Fable 573.67%

5.Claude Opus 573.56%

6.GPT-5.6 Sol72.34%

7.Gemini 3.8 Flash72.2%

8.GPT-6 Astra71.7%

9.GPT-6 Sol71.53%

10.Gemini 3.7 Flash71.33%

11.Claude Opus 4.869.37%

12.GPT-6 Luna68.52%

13.GPT-5.6 Luna67.12%

14.Grok 4.766.99%

15.Kimi K366.4%

16.Claude Sonnet 566.32%

17.GPT-5.6 Terra66.21%

18.Gemini 3.6 Flash65.41%

19.GPT-5.564.54%

20.Claude Opus 4.763.73%

21.Gemini 3.5 Flash63.55%

22.Grok 4.662.73%

23.GLM-5.261.53%

24.Claude Sonnet 4.660.15%

25.Qwen 3.8 Max 090260.07%

26.Qwen 3.8 27B59.66%

27.Kimi K2.657.86%

28.DeepSeek-V4.1-Flash57.21%

29.Qwen 3.7 Max57.04%

30.GLM-5.356.34%

31.GLM-5.3-Flash55.93%

32.MiMo-V2.5-Pro55.23%

33.MiMo-V2.555.09%

34.Grok 4.552.91%

35.Gemini 3.1 Pro Preview52.62%

36.DeepSeek-V4-Pro51.62%

37.Qwen 3.7 Plus49.35%

38.MiniMax M347.76%

39.GPT-5.4 mini45.43%

40.GPT-5.4 nano44.75%

41.Gemini 3.5 Flash-Lite43.23%

42.Inkling38.36%

43.Inkling Small31.76%

44.Nemotron 3 Ultra31.74%

45.Kimi K2.528.47%

46.MiniMax M2.728.45%

47.Gemini 3 Flash Preview26.02%

48.Ling 3.0 Flash25.01%

49.Grok 4.318.39%

50.Nemotron 3.5 Lightning16.99%

51.Grok 4.20 Reasoning11.74%

52.Mistral Medium 3.511.19%

53.Gemini 3.1 Flash-Lite8.63%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-emb:1:overall
Metric: accuracy
Scale: 0-100
Participants: 53
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 2204.991. Cost per task in USD: 8.792863. Source ID: vals-ai. Evidence capture ID: vals-emb-2026-09-29-90535b2fd4dc. Source payload hash: 90535b2fd4dc213540eac0aff8ae769e34b6b1ba54e1ed6d0a51dcfe307d5598. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Finance Agent (v2)

Overall

1.Gemini 3.8 Flash61.44%

2.Gemini 3.7 Flash59.04%

3.Claude Fable 5.158.88%

4.Claude Opus 558.63%

5.Claude Opus 5.558.59%

6.Claude Sonnet 5.558.1%

7.Gemini 3.5 Flash57.86%

8.GLM-5.3-Flash57.85%

9.Claude Fable 556.31%

10.Gemini 3.6 Flash56.3%

11.GLM-5.355.84%

12.GPT-5.6 Luna55.04%

13.GPT-5.6 Terra54.44%

14.Kimi K354.36%

15.Claude Opus 4.853.92%

16.Claude Sonnet 553.91%

17.GPT-5.6 Sol53.76%

18.Grok 4.653.68%

19.GPT-6 Astra53.54%

20.DeepSeek-V4.1-Flash53.48%

21.Grok 4.752.25%

22.GPT-5.551.76%

23.Claude Opus 4.751.51%

24.Claude Sonnet 4.651.04%

25.Qwen 3.8 Max 090250.59%

26.GPT-6 Luna49.87%

27.GLM-5.249.7%

28.GPT-6 Sol49.05%

29.Qwen 3.8 27B48.55%

30.Grok 4.548.35%

31.MiniMax M348.27%

32.Qwen 3.7 Max47.78%

33.Gemini 3.5 Flash-Lite47.44%

34.Inkling46.6%

35.GPT-5.4 mini45.36%

36.Kimi K2.644.9%

37.GLM-5.144.79%

38.DeepSeek-V4-Pro44.08%

39.Gemini 3.1 Pro Preview42.98%

40.Gemini 3 Flash Preview42.55%

41.MiMo-V2.5-Pro41.5%

42.Inkling Small41.26%

43.Qwen 3.7 Plus38.22%

44.GPT-5.4 nano38.22%

45.Grok 4.337.73%

46.Nemotron 3 Ultra37.67%

47.MiMo-V2.536.73%

48.Kimi K2.535.79%

49.Mistral Medium 3.532.1%

50.Ling 3.0 Flash30.31%

51.Gemini 3.1 Flash-Lite29.99%

52.Grok 4.20 Reasoning28.49%

53.MiniMax M2.727.89%

54.Nemotron 3.5 Lightning18.5%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-finance-agent-v2:2:overall
Metric: accuracy
Scale: 0-100
Participants: 54
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 1903.336. Cost per task in USD: 6.552431. Source ID: vals-ai. Evidence capture ID: vals-fabv2-2026-09-29-addcd124c670. Source payload hash: addcd124c6706893659c1ae26698bf6ffa29c91018ee95b98ab15b9d4b6edcdb. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Legal

Harvey's Legal Agent Benchmark

Overall · Task fully resolved

1.Grok 4.615.83%

2.Grok 4.512.92%

3.Grok 4.712.5%

4.Claude Fable 511.25%

4.Qwen 3.8 27B11.25%

6.Kimi K310.83%

7.Qwen 3.8 Max 090210.42%

8.Gemini 3.8 Flash10%

9.Claude Opus 4.89.58%

10.Gemini 3.7 Flash8.75%

11.GLM-5.38.33%

12.GLM-5.27.08%

13.Claude Fable 5.16.67%

13.Claude Opus 4.76.67%

13.Claude Opus 56.67%

13.DeepSeek-V4.1-Flash6.67%

13.GLM-5.3-Flash6.67%

18.GPT-6 Astra5.42%

19.Claude Sonnet 4.65%

19.Claude Sonnet 55%

21.MiniMax M34.17%

22.Claude Opus 5.53.75%

22.DeepSeek-V4-Pro3.75%

22.GPT-5.53.75%

25.Gemini 3.6 Flash3.33%

26.Claude Sonnet 5.52.92%

26.GPT-6 Luna2.92%

28.Gemini 3.5 Flash2.5%

28.GPT-5.6 Sol2.5%

30.Inkling2.08%

30.MiMo-V2.5-Pro2.08%

32.GPT-6 Sol1.67%

32.Inkling Small1.67%

32.Kimi K2.61.67%

32.MiMo-V2.51.67%

32.Qwen 3.7 Max1.67%

37.GPT-5.6 Luna1.25%

37.Ling 3.0 Flash1.25%

39.GPT-5.6 Terra0.83%

40.Grok 4.30.42%

40.Mistral Medium 3.50.42%

40.Nemotron 3 Ultra0.42%

43.Gemini 3 Flash Preview0%

43.Gemini 3.1 Flash-Lite0%

43.Gemini 3.1 Pro Preview0%

43.Gemini 3.5 Flash-Lite0%

43.GLM-5.10%

43.GPT-5.40%

43.GPT-5.4 mini0%

43.GPT-5.4 nano0%

43.Grok 4.20 Reasoning0%

43.Kimi K2.50%

43.MiniMax M2.70%

43.Nemotron 3.5 Lightning0%

43.Qwen 3.7 Plus0%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-legal-agent-benchmark:1:overall
Metric: task resolution rate
Scale: 0-100
Participants: 55
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-27. Latency in seconds: 3463.508. Cost per task in USD: 16.612583. Source ID: vals-ai. Evidence capture ID: vals-hlab-2026-09-29-d6fb708e5bcc. Source payload hash: d6fb708e5bccec56c7a5e5ad97918d9cc47c5ebefb88af4a1a5771493dadba2f. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Legal Research Bench

Overall · All-pass

1.Claude Fable 5.155.29%

1.Claude Opus 555.29%

3.Claude Opus 5.550.48%

4.Claude Fable 549.52%

5.GLM-5.349.04%

6.Claude Sonnet 5.548.08%

6.GPT-5.6 Sol48.08%

6.Grok 4.648.08%

9.Qwen 3.8 Max 090247.6%

10.Grok 4.747.12%

11.GLM-5.3-Flash45.19%

12.Kimi K344.23%

13.Claude Opus 4.843.75%

14.Claude Sonnet 541.83%

15.DeepSeek-V4.1-Flash41.35%

15.GPT-5.6 Terra41.35%

17.GPT-5.540.39%

18.GPT-6 Astra39.42%

19.Gemini 3.8 Flash38.94%

20.Claude Opus 4.738.46%

20.Claude Sonnet 4.638.46%

22.Grok 4.537.98%

23.GPT-5.6 Luna36.54%

24.Qwen 3.8 27B36.06%

25.Gemini 3.7 Flash34.62%

26.GLM-5.231.25%

27.Gemini 3.5 Flash30.77%

28.GPT-6 Luna30.29%

29.MiniMax M329.81%

30.GPT-6 Sol28.85%

31.Inkling28.37%

32.GLM-5.127.89%

33.Inkling Small25.48%

33.Qwen 3.7 Max25.48%

35.Gemini 3.6 Flash25%

36.DeepSeek-V4-Pro23.08%

37.Gemini 3.1 Pro Preview20.67%

38.Gemini 3 Flash Preview18.27%

39.Qwen 3.7 Plus16.35%

40.Kimi K2.515.87%

40.Kimi K2.615.87%

40.MiMo-V2.5-Pro15.87%

43.Grok 4.315.39%

43.Nemotron 3 Ultra15.39%

45.Gemini 3.5 Flash-Lite13.94%

45.Grok 4.20 Reasoning13.94%

47.GPT-5.4 mini12.5%

48.MiniMax M2.710.58%

49.MiMo-V2.59.14%

49.Mistral Medium 3.59.14%

51.GPT-5.4 nano6.25%

52.Gemini 3.1 Flash-Lite3.37%

53.Nemotron 3.5 Lightning2.89%

54.Ling 3.0 Flash0%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-legal-research:1:overall
Metric: all-pass rate
Scale: 0-100
Participants: 54
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 5588.989. Cost per task in USD: 14.826571. Source ID: vals-ai. Evidence capture ID: vals-legal_research-2026-09-29-b15acd492114. Source payload hash: b15acd492114174e151eff7ff17a38d547d5a1e93d2d598c153066542bbc56b7. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Health

MedCode

Overall

1.Claude Opus 563.57%

2.Gemini 3.1 Pro Preview59.06%

3.Claude Fable 556.07%

4.Gemini 3 Flash Preview55.92%

5.Gemini 3.5 Flash55.83%

6.Claude Opus 4.754.86%

7.Claude Fable 5.153.51%

8.Gemini 3.7 Flash53.39%

9.Claude Opus 4.853.22%

10.Gemini 3.6 Flash53.15%

11.Claude Sonnet 5.552.92%

12.Gemini 2.5 Pro50.59%

13.Claude Opus 5.549.8%

14.GPT-549.63%

15.Grok 4.749.55%

16.GPT-5.549.1%

17.Kimi K348.88%

18.GPT-6 Astra48.49%

19.Claude Opus 4.648.24%

20.Gemini 3.8 Flash48.14%

21.Gemini 3.1 Flash-Lite47.6%

22.Claude Sonnet 547.54%

23.o347.29%

24.GPT-6 Sol47.07%

25.MiniMax M346.29%

26.Claude Opus 4.545.17%

27.Grok 4.644.71%

28.GPT-6 Luna44.69%

29.GPT-5.6 Sol43.97%

30.Gemini 3.5 Flash-Lite43.49%

31.GPT-5.6 Terra43.41%

32.Grok 4.543.29%

33.GPT-5 mini43.05%

34.GLM-5.342.86%

35.GPT-5.6 Luna42.39%

36.GLM-5.141.6%

37.GPT-5.441.29%

38.Inkling41.19%

39.DeepSeek-V4.1-Flash41.17%

40.GPT-5.4 nano41.03%

41.GLM-5.240.77%

42.Qwen 3.8 Max 090240.67%

43.Claude Sonnet 4.540.57%

44.DeepSeek-V4-Pro40.46%

45.Kimi K2.640.14%

46.Kimi K2.539.32%

47.Qwen 3.7 Max38.75%

48.Nemotron 3 Ultra38.62%

49.Grok 4.338.07%

50.Inkling Small37.89%

51.MiniMax M2.734.44%

52.MiniMax M2.134.08%

53.o4-mini33.79%

54.Mistral Medium 3.533.75%

55.GLM-4.732.77%

56.MiMo-V2.5-Pro32.48%

57.Ling 3.0 Flash32.28%

58.Grok 4.20 Reasoning32.16%

59.MiMo-V2.531.9%

60.GPT-5 nano30.44%

61.Qwen 3.8 27B28.7%

62.Gemini 2.5 Flash-Lite27.12%

63.Llama 4 Scout23.31%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-medcode:1:overall
Metric: accuracy
Scale: 0-100
Participants: 63
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-26. Latency in seconds: 239.171. Cost per task in USD: 0.391592. Source ID: vals-ai. Evidence capture ID: vals-medcode-2026-09-29-7062229b5ab4. Source payload hash: 7062229b5ab4a5e16f014a78fd550f9f34e7147be6be796b610ab1ca3de055ab. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

MedScribe

Overall

1.Claude Opus 5.591.43%

2.Claude Fable 5.191.29%

3.Claude Sonnet 5.591.1%

4.Claude Opus 590.99%

5.Grok 4.789.38%

6.GLM-5.3-Flash88.94%

7.GLM-5.388.81%

8.Claude Fable 588.52%

9.Kimi K387.96%

10.GPT-6 Astra87.91%

11.MiniMax M387.25%

12.Grok 4.586.88%

13.GPT-5.586.87%

14.Claude Opus 4.686.74%

15.Grok 4.686.53%

16.Claude Opus 4.885.76%

17.DeepSeek-V4.1-Flash85.5%

18.Inkling85.41%

19.GPT-5.6 Sol85.23%

20.Qwen 3.8 Max 090284.95%

21.Claude Sonnet 4.584.52%

22.Gemini 3.8 Flash84.5%

23.GPT-5.6 Luna84.39%

24.Inkling Small84.11%

25.Gemini 3.7 Flash83.94%

26.Qwen 3.8 27B83.85%

27.MiMo-V2.5-Pro83.73%

28.GPT-6 Luna83.71%

29.GPT-583.65%

30.GLM-5.283.53%

31.Claude Opus 4.583.25%

32.Claude Opus 4.782.95%

33.GPT-5.6 Terra82.87%

34.GPT-6 Sol82.03%

35.Ling 3.0 Flash80.9%

36.MiniMax M2.180.78%

37.GPT-5 mini80.58%

38.MiniMax M2.779.87%

39.Gemini 3.6 Flash79.66%

40.Qwen 3.7 Max79.4%

41.Kimi K2.678.15%

42.GPT-5.477.55%

43.GPT-5.4 nano77.09%

44.o376.65%

45.Gemini 3.5 Flash76.57%

46.Kimi K2.576.44%

47.Gemini 3.1 Pro Preview76.11%

48.Claude Sonnet 576.05%

49.DeepSeek-V4-Pro75.14%

50.Grok 4.374.4%

51.Gemini 2.5 Pro73.55%

52.GPT-5 nano72.87%

53.Gemini 2.5 Flash-Lite72.83%

54.GLM-5.172.27%

55.MiMo-V2.572.15%

56.Gemini 3.5 Flash-Lite70.89%

57.Gemini 3 Flash Preview69.92%

58.o4-mini69.14%

59.GLM-4.768.63%

60.Mistral Medium 3.567.73%

61.Gemini 3.1 Flash-Lite63.9%

62.Grok 4.20 Reasoning63.41%

63.Llama 4 Scout50.59%

64.Nemotron 3.5 Lightning4.27%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-medscribe:1:overall
Metric: accuracy
Scale: 0-100
Participants: 64
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-26. Latency in seconds: 306.811. Cost per task in USD: 0.508604. Source ID: vals-ai. Evidence capture ID: vals-medscribe-2026-09-29-6533d95c8055. Source payload hash: 6533d95c80553d2dd26927f7269ab6454c589d2181f1858c662a4f493b5685c7. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

ProofBench

Overall

1.Claude Fable 5.1100%

1.Claude Opus 5.5100%

1.Claude Sonnet 5.5100%

4.Claude Opus 599%

4.GPT-6 Astra99%

6.Claude Fable 595%

7.Kimi K387%

8.GPT-5.6 Sol83%

8.GPT-6 Sol83%

10.Claude Sonnet 577%

11.GPT-5.6 Terra74%

12.GPT-6 Luna64%

13.GPT-5.6 Luna60%

14.Gemini 3.7 Flash58%

14.Qwen 3.8 Max 090258%

16.DeepSeek-V4.1-Flash54%

17.Grok 4.651%

18.GLM-5.349%

19.Gemini 3.8 Flash48%

20.Gemini 3.5 Flash31%

20.Grok 4.531%

22.Gemini 3.1 Pro Preview26%

22.Grok 4.726%

24.MiMo-V2.5-Pro22%

25.GLM-5.3-Flash21%

26.MiniMax M318%

27.DeepSeek-V4-Pro16%

27.MiMo-V2.516%

27.Qwen 3.8 27B16%

30.Mistral Medium 3.59%

31.Inkling Small6%

32.Inkling0%

32.Nemotron 3.5 Lightning0%

higher is betterAs of September 29, 2026Scale: 0% - 100%

Source: Vals AI

CC BY 4.0

gradually.ai

Methodology and context

Comparison cohort: vals-proof-bench:1.1:overall
Metric: accuracy
Scale: 0-100
Participants: 33
Methodology and context: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-28. Latency in seconds: 347.583. Cost per task in USD: 0.558327. Source ID: vals-ai. Evidence capture ID: vals-proof_bench-2026-09-29-95d190db7be5. Source payload hash: 95d190db7be508012399269386113bf7df88cf108a8647fae6d361d15c60126b. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source: Vals AI

Recorded measurement details

Every observation retains its source value and published test conditions.

BioMysteryBench: Overall (Show measurement, test conditions, and source)

Source value: 81.111
Score: 81.111
Metric: accuracy
Unit: %
Benchmark version: 1
Category: general
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-biomysterybench:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-27. Harness: Terminus 2. Latency in seconds: 1086.061. Cost per task in USD: 3.736494. Source ID: vals-ai. Evidence capture ID: vals-biomysterybench-2026-09-29-ae8417ff089d. Source payload hash: ae8417ff089d100a7fe142b979f417441381dcedfb13f35f1e2a2f4d06f31aec. Parser version: vals-astro-v2. Imported at: 2026-09-29
Comparison methodology: Harness: Terminus 2

Source Vals AI

Code Migration: Overall (Show measurement, test conditions, and source)

Source value: 69.825
Score: 69.825
Metric: accuracy
Unit: %
Benchmark version: 1
Category: coding
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-code-migration:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 12004.483. Cost per task in USD: 75.826721. Source ID: vals-ai. Evidence capture ID: vals-code-migration-2026-09-29-f0b317d5bed3. Source payload hash: f0b317d5bed3a2654a9ea39762d5e57f4649306adce3e6103e845ee1b9b94add. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

CyberBench v1.1: Overall (Show measurement, test conditions, and source)

Source value: 59.584
Score: 59.584
Metric: accuracy
Unit: %
Benchmark version: 1.1
Category: cybersecurity
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-cyberbench:1.1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 2032.625. Cost per task in USD: 4.417372. Source ID: vals-ai. Evidence capture ID: vals-cyber-2026-09-29-36ddb5f67bc8. Source payload hash: 36ddb5f67bc8725a7ff9d1cc1349f89d29e0e907ad313eb5ac277b42b3d275e1. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

EMB: Overall (Show measurement, test conditions, and source)

Source value: 75.713
Score: 75.713
Metric: accuracy
Unit: %
Benchmark version: 1
Category: finance
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-emb:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 2204.991. Cost per task in USD: 8.792863. Source ID: vals-ai. Evidence capture ID: vals-emb-2026-09-29-90535b2fd4dc. Source payload hash: 90535b2fd4dc213540eac0aff8ae769e34b6b1ba54e1ed6d0a51dcfe307d5598. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

Finance Agent (v2): Overall (Show measurement, test conditions, and source)

Source value: 58.103
Score: 58.103
Metric: accuracy
Unit: %
Benchmark version: 2
Category: finance
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-finance-agent-v2:2:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 1903.336. Cost per task in USD: 6.552431. Source ID: vals-ai. Evidence capture ID: vals-fabv2-2026-09-29-addcd124c670. Source payload hash: addcd124c6706893659c1ae26698bf6ffa29c91018ee95b98ab15b9d4b6edcdb. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

IOI: Overall (Show measurement, test conditions, and source)

Source value: 83.056
Score: 83.056
Metric: accuracy
Unit: %
Benchmark version: 2
Category: coding
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-ioi:2:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-27. Latency in seconds: 2751.084. Cost per task in USD: 7.524252. Source ID: vals-ai. Evidence capture ID: vals-ioi-2026-09-29-14c4f2dcc872. Source payload hash: 14c4f2dcc872d5e07bce234aebe4932202931d7f5b05f9bcd02e7695b5664750. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

Harvey's Legal Agent Benchmark: Overall · Task fully resolved (Show measurement, test conditions, and source)

Source value: 2.917
Score: 2.917
Metric: task resolution rate
Unit: %
Benchmark version: 1
Category: legal
Task: overall
Task label: Overall · Task fully resolved
Direction: Higher is better
Comparison cohort: vals-legal-agent-benchmark:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: public. Leaderboard date: 2026-09-27. Latency in seconds: 3463.508. Cost per task in USD: 16.612583. Source ID: vals-ai. Evidence capture ID: vals-hlab-2026-09-29-d6fb708e5bcc. Source payload hash: d6fb708e5bccec56c7a5e5ad97918d9cc47c5ebefb88af4a1a5771493dadba2f. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

Legal Research Bench: Overall · All-pass (Show measurement, test conditions, and source)

Source value: 48.077
Score: 48.077
Metric: all-pass rate
Unit: %
Benchmark version: 1
Category: legal
Task: overall
Task label: Overall · All-pass
Direction: Higher is better
Comparison cohort: vals-legal-research:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 5588.989. Cost per task in USD: 14.826571. Source ID: vals-ai. Evidence capture ID: vals-legal_research-2026-09-29-b15acd492114. Source payload hash: b15acd492114174e151eff7ff17a38d547d5a1e93d2d598c153066542bbc56b7. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

MedCode: Overall (Show measurement, test conditions, and source)

Source value: 52.92
Score: 52.92
Metric: accuracy
Unit: %
Benchmark version: 1
Category: health
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-medcode:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-26. Latency in seconds: 239.171. Cost per task in USD: 0.391592. Source ID: vals-ai. Evidence capture ID: vals-medcode-2026-09-29-7062229b5ab4. Source payload hash: 7062229b5ab4a5e16f014a78fd550f9f34e7147be6be796b610ab1ca3de055ab. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

MedScribe: Overall (Show measurement, test conditions, and source)

Source value: 91.101
Score: 91.101
Metric: accuracy
Unit: %
Benchmark version: 1
Category: health
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-medscribe:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-26. Latency in seconds: 306.811. Cost per task in USD: 0.508604. Source ID: vals-ai. Evidence capture ID: vals-medscribe-2026-09-29-6533d95c8055. Source payload hash: 6533d95c80553d2dd26927f7269ab6454c589d2181f1858c662a4f493b5685c7. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

MysteryMechanism: Overall (Show measurement, test conditions, and source)

Source value: 49.099
Score: 49.099
Metric: accuracy
Unit: %
Benchmark version: 1
Category: general
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-mysterymechanism:1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-27. Latency in seconds: 1410.236. Cost per task in USD: 3.45323. Source ID: vals-ai. Evidence capture ID: vals-mysterymechanism-2026-09-29-258cfbb1bd2e. Source payload hash: 258cfbb1bd2e39fcae6d5a1181c9808368bbc3987691d3d1b32b5d193fc465a7. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

ProofBench: Overall (Show measurement, test conditions, and source)

Source value: 100
Score: 100
Metric: accuracy
Unit: %
Benchmark version: 1.1
Category: math
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: vals-proof-bench:1.1:overall
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-09-29
Methodology: Source model ID: anthropic/claude-sonnet-5-5. Source model name: Claude Sonnet 5.5. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-09-28. Latency in seconds: 347.583. Cost per task in USD: 0.558327. Source ID: vals-ai. Evidence capture ID: vals-proof_bench-2026-09-29-95d190db7be5. Source payload hash: 95d190db7be508012399269386113bf7df88cf108a8647fae6d361d15c60126b. Parser version: vals-astro-v2. Imported at: 2026-09-29

Source Vals AI

Page 1 of 4

Profile

Specifications and access

Published information about this model. Existing estimates are explicitly labeled.

Dated documentation and model-card observations. Provider limits, native context and extended context can differ. Configuration notes retain the source wording.

Specification	Value and source
Weights	ProprietarySource
Access	APISource
Context window	1,000,000 tokensSource
Knowledge cutoff	June 2026Source
Notes	Released September 28, 2026. Anthropic positions Sonnet 5.5 as a faster, lower-cost complement to Opus 5.5 for well-scoped everyday tasks, bug fixing, and documents, slides, and spreadsheets, priced at the unchanged Sonnet 5 rate of $2 / $10 per million input and output tokens. 1M context, 128K output, a June 2026 knowledge cutoff, adaptive thinking on by default, and high effort by default on the API (medium in Claude Code and the apps). Official API ID: claude-sonnet-5-5.Source
API model ID	claude-sonnet-5-5Source
Source status	activeSource
Release	2026-09-28Source
Maximum output	128,000 tokensSource
Input	Text, imagesSource
Output	TextSource
Reasoning mode	adaptive (on by default; between_tools turns off up-front thinking); default highSource
Reasoning effort	low, medium, high, xhigh, max; API default highSource
Knowledge cutoff	2026-06Source

Model generations

Predecessor and successor

Every relationship names its kind, its qualification and the dated source it rests on.

Evidence

Sources and data date

Every statement links to its underlying documentation or leaderboard.

Type	Evidence and data date
Price	Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs. Source: Pricing · Model metadata (retrieved September 28, 2026)
Input	Documented modalities. Retrieved September 28, 2026. Source: Model documentation · Model metadata (retrieved September 28, 2026)
Output	Documented modalities. Retrieved September 28, 2026. Source: Model documentation · Model metadata (retrieved September 28, 2026)
Research status	Research date September 28, 2026. 5 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Not found in the inspected sources	parameters-billions Original wording Anthropic does not publish parameter counts for this model.
Not found in the inspected sources	active-parameters-billions Original wording Anthropic does not publish active parameter counts for this model.
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Vals AI (retrieved September 29, 2026)
Additional source	Anthropic (retrieved September 28, 2026)
Additional source	Model metadata (retrieved September 28, 2026)
Additional source	Model metadata (retrieved September 28, 2026)
Additional source	Anthropic "Introducing Claude Sonnet 5.5" announcement (2026-09-28)

Claude Sonnet 5.5

Published benchmarks

General tasks

BioMysteryBench

MysteryMechanism

Coding

Code Migration

IOI

CyberBench v1.1

Finance

EMB

Finance Agent (v2)

Legal

Harvey's Legal Agent Benchmark

Legal Research Bench

Health

MedCode

MedScribe

ProofBench

Recorded measurement details

Specifications and access

Published prices

Compare this model

Predecessor and successor

Sources and data date