Jared PalmerDecision matchup
Kev 0.8Bvs.Kev 9B
Which model makes better decisions?
Kev 9B does better in independent tests, while Kev 0.8B is more popular.
Pick Kev 0.8B for
Pick Kev 9B for
Shared tests
Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.
Jev Decision Index
Kev 9B aheadKev 9B is clearly ahead in 21 of 37 subtests and slightly in 13, Kev 0.8B in 1. 2 are level.
Home appliances · Decision Index 0.4.1
88 tasks, as of October 28, 2026
POP909 · Decision Index 0.4.1
2,000 tasks, as of October 28, 2026
SATA-Bench · Decision Index 0.4.1
1,650 tasks, as of October 28, 2026
Show all 37 subtests
| Subtest | Kev 0.8B | Kev 9B | Verdict |
|---|---|---|---|
| Home appliances · Decision Index 0.4.1 | 0.0 | 11.4 | Kev 9B ahead |
| POP909 · Decision Index 0.4.1 | 1.5 | 10.2 | Kev 9B ahead |
| SATA-Bench · Decision Index 0.4.1 | 9.0 | 30.7 | Kev 9B ahead |
| GSM8K · Decision Index 0.4.1 | 19.0 | 54.4 | Kev 9B ahead |
| MMLU-Pro · Decision Index 0.4.1 | 22.3 | 56.5 | Kev 9B ahead |
| New Yorker · Decision Index 0.4.1 | 27.8 | 56.6 | Kev 9B ahead |
| HellaSwag · Decision Index 0.4.1 | 42.9 | 82.7 | Kev 9B ahead |
| BBH · Decision Index 0.4.1 | 41.4 | 66.3 | Kev 9B ahead |
| ChessBench · Decision Index 0.4.1 | 7.9 | 12.0 | Kev 9B ahead |
| API-Bank · Decision Index 0.4.1 | 43.7 | 65.4 | Kev 9B ahead |
| CRUXEval · Decision Index 0.4.1 | 37.7 | 55.4 | Kev 9B ahead |
| WinoGrande · Decision Index 0.4.1 | 52.8 | 75.1 | Kev 9B ahead |
| When2Call · Decision Index 0.4.1 | 43.2 | 60.7 | Kev 9B ahead |
| BFCL · Decision Index 0.4.1 | 70.5 | 95.2 | Kev 9B ahead |
| CLadder · Decision Index 0.4.1 | 50.5 | 63.5 | Kev 9B ahead |
| BPoMP · Decision Index 0.4.1 | 47.7 | 58.9 | Kev 9B ahead |
| Habermas · Decision Index 0.4.1 | 33.4 | 40.0 | Kev 9B ahead |
| PhishNChips · Decision Index 0.4.1 | 51.7 | 61.6 | Kev 9B ahead |
| HoVer · Decision Index 0.4.1 | 51.0 | 60.7 | Kev 9B ahead |
| MuSR · Decision Index 0.4.1 | 48.9 | 56.5 | Kev 9B ahead |
| Humicroedit · Decision Index 0.4.1 | 50.9 | 57.3 | Kev 9B ahead |
| cfcolor · Decision Index 0.4.1 | 55.4 | 53.0 | Kev 0.8B ahead |
| CLINC150 · Decision Index 0.4.1 | 15.0 | 77.1 | Kev 9B slightly ahead |
| iSarcasmEval · Decision Index 0.4.1 | 19.9 | 43.2 | Kev 9B slightly ahead |
| Amazon ESCI · Decision Index 0.4.1 | 22.9 | 49.1 | Kev 9B slightly ahead |
| ANLI · Decision Index 0.4.1 | 33.6 | 58.1 | Kev 9B slightly ahead |
| ACOS · Decision Index 0.4.1 | 9.9 | 17.0 | Kev 9B slightly ahead |
| ContractNLI · Decision Index 0.4.1 | 40.9 | 65.3 | Kev 9B slightly ahead |
| RAGTruth · Decision Index 0.4.1 | 46.2 | 70.6 | Kev 9B slightly ahead |
| VAST · Decision Index 0.4.1 | 40.6 | 56.7 | Kev 9B slightly ahead |
| NLI4CT · Decision Index 0.4.1 | 55.9 | 75.2 | Kev 9B slightly ahead |
| FinEntity · Decision Index 0.4.1 | 71.4 | 89.7 | Kev 9B slightly ahead |
| ToolRet · Decision Index 0.4.1 | 51.7 | 63.8 | Kev 9B slightly ahead |
| BRIGHT · Decision Index 0.4.1 | 31.8 | 38.2 | Kev 9B slightly ahead |
| BANKING77 · Decision Index 0.4.1 | 77.6 | 83.3 | Kev 9B slightly ahead |
| HLE · Decision Index 0.4.1 | 13.8 | 11.0 | level |
| GPQA Diamond · Decision Index 0.4.1 | 33.2 | 37.8 | level |
Source · latest October 28, 2026
Kevala decision benchmark report
Kev 9B aheadKev 9B is clearly ahead in 2 of 3 subtests and slightly in 1, Kev 0.8B in none.
Kevala semif-perturbations108 decision accuracy
95 % ranges 57.4 to 84.0 and 90.7 to 100.0, 972 tasks, as of October 23, 2026
Kevala semif-authored144 decision accuracy
95 % ranges 64.6 to 77.3 and 88.2 to 95.6, 1,296 tasks, as of October 23, 2026
Kevala kevala-authored36 decision accuracy
95 % ranges 79.6 to 97.2 and 89.8 to 100.0, 324 tasks, as of October 23, 2026
Source · latest October 23, 2026
Duan et al., General Decision Models: Benchmarking and Insights Beyond Jev
Kev 9B aheadJEVal aida-testc accuracy
200 tasks, as of October 22, 2026
Source · latest October 22, 2026
Vendor figures
Figures from vendor reports that cover both models. They do not count toward the verdict.
Show 1 vendor figures
| Figure | Source | Kev 0.8B | Kev 9B |
|---|---|---|---|
| 14-public-dataset calibration error, per-dataset average (lower is better) | Jared Palmer, Introducing Kev | 0.10 | 0.10 |