Convai InnovationsJared PalmerDecision matchup
Layavs.Kev 0.8B
Which model makes better decisions?
Kev 0.8B does better in independent tests.
Pick Laya for
Pick Kev 0.8B for
Shared tests
Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.
Jev Decision Index
Kev 0.8B aheadKev 0.8B is clearly ahead in 10 of 37 subtests and slightly in 9, Laya in 4 clearly and slightly in 3. 11 are level.
SATA-Bench · Decision Index 0.4.1
1,650 tasks, as of October 28, 2026
API-Bank · Decision Index 0.4.1
508 tasks, as of October 28, 2026
When2Call · Decision Index 0.4.1
3,652 tasks, as of October 28, 2026
Show all 37 subtests
| Subtest | Laya | Kev 0.8B | Verdict |
|---|---|---|---|
| SATA-Bench · Decision Index 0.4.1 | 0.3 | 9.0 | Kev 0.8B ahead |
| API-Bank · Decision Index 0.4.1 | 11.5 | 43.7 | Kev 0.8B ahead |
| When2Call · Decision Index 0.4.1 | 11.9 | 43.2 | Kev 0.8B ahead |
| POP909 · Decision Index 0.4.1 | 5.1 | 1.5 | Laya ahead |
| BFCL · Decision Index 0.4.1 | 38.1 | 70.5 | Kev 0.8B ahead |
| MMLU-Pro · Decision Index 0.4.1 | 13.6 | 22.3 | Kev 0.8B ahead |
| HellaSwag · Decision Index 0.4.1 | 33.1 | 42.9 | Kev 0.8B ahead |
| BBH · Decision Index 0.4.1 | 34.1 | 41.4 | Kev 0.8B ahead |
| MuSR · Decision Index 0.4.1 | 43.2 | 48.9 | Kev 0.8B ahead |
| HoVer · Decision Index 0.4.1 | 55.8 | 51.0 | Laya ahead |
| BPoMP · Decision Index 0.4.1 | 51.6 | 47.7 | Laya ahead |
| Humicroedit · Decision Index 0.4.1 | 47.2 | 50.9 | Kev 0.8B ahead |
| cfcolor · Decision Index 0.4.1 | 52.3 | 55.4 | Kev 0.8B ahead |
| CLadder · Decision Index 0.4.1 | 52.9 | 50.5 | Laya ahead |
| BANKING77 · Decision Index 0.4.1 | 14.3 | 77.6 | Kev 0.8B slightly ahead |
| CLINC150 · Decision Index 0.4.1 | 3.2 | 15.0 | Kev 0.8B slightly ahead |
| ToolRet · Decision Index 0.4.1 | 12.8 | 51.7 | Kev 0.8B slightly ahead |
| ACOS · Decision Index 0.4.1 | 3.5 | 9.9 | Kev 0.8B slightly ahead |
| BRIGHT · Decision Index 0.4.1 | 19.9 | 31.8 | Kev 0.8B slightly ahead |
| ANLI · Decision Index 0.4.1 | 48.7 | 33.6 | Laya slightly ahead |
| ContractNLI · Decision Index 0.4.1 | 29.0 | 40.9 | Kev 0.8B slightly ahead |
| iSarcasmEval · Decision Index 0.4.1 | 14.9 | 19.9 | Kev 0.8B slightly ahead |
| NLI4CT · Decision Index 0.4.1 | 47.7 | 55.9 | Kev 0.8B slightly ahead |
| FinEntity · Decision Index 0.4.1 | 61.0 | 71.4 | Kev 0.8B slightly ahead |
| Amazon ESCI · Decision Index 0.4.1 | 24.4 | 22.9 | Laya slightly ahead |
| RAGTruth · Decision Index 0.4.1 | 48.8 | 46.2 | Laya slightly ahead |
| GPQA Diamond · Decision Index 0.4.1 | 27.6 | 33.2 | level |
| GSM8K · Decision Index 0.4.1 | 16.9 | 19.0 | level |
| CRUXEval · Decision Index 0.4.1 | 40.2 | 37.7 | level |
| WinoGrande · Decision Index 0.4.1 | 50.5 | 52.8 | level |
| ChessBench · Decision Index 0.4.1 | 7.7 | 7.9 | level |
| PhishNChips · Decision Index 0.4.1 | 50.1 | 51.7 | level |
| New Yorker · Decision Index 0.4.1 | 27.1 | 27.8 | level |
| HLE · Decision Index 0.4.1 | 14.0 | 13.8 | level |
| Habermas · Decision Index 0.4.1 | 33.4 | 33.4 | level |
| VAST · Decision Index 0.4.1 | 40.5 | 40.6 | level |
| Home appliances · Decision Index 0.4.1 | 0.0 | 0.0 | level |
Source · latest October 28, 2026
Zero-shot IE benchmark
levelZero-shot IE spectrum: mixed-pool classification accuracy
48 tasks, as of October 17, 2026
Source · latest October 17, 2026