Jared PalmerContrastive-LMDecision matchup
Kev 4Bvs.CLM-v0.1-8B
Which model makes better decisions?
Kev 4B does better in independent tests, while CLM-v0.1-8B is more popular.
Independent testsJev Decision Index
Kev 4Bahead1 of 1
CLM-v0.1-8B0 of 1
Popularityout of 100
Kev 4B23
CLM-v0.1-8Bahead37
Weights and access
Kev 4Bopen, local
CLM-v0.1-8Bopen, local
SizeParameters
Kev 4Bn/a
CLM-v0.1-8B8 B
Pick Kev 4B for
Jev Decision Index
Pick CLM-v0.1-8B for
more popular
Shared tests
Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.
Jev Decision Index
Kev 4B aheadKev 4B is clearly ahead in 19 of 37 subtests and slightly in 13, CLM-v0.1-8B in 2. 3 are level.
Home appliances · Decision Index 0.4.1
Kev 4B14.8
CLM-v0.1-8B0.0
88 tasks, as of October 28, 2026
POP909 · Decision Index 0.4.1
Kev 4B1.2
CLM-v0.1-8B0.0
2,000 tasks, as of October 28, 2026
API-Bank · Decision Index 0.4.1
Kev 4B53.3
CLM-v0.1-8B6.1
508 tasks, as of October 28, 2026
Show all 37 subtests
| Subtest | Kev 4B | CLM-v0.1-8B | Verdict |
|---|---|---|---|
| Home appliances · Decision Index 0.4.1 | 14.8 | 0.0 | Kev 4B ahead |
| POP909 · Decision Index 0.4.1 | 1.2 | 0.0 | Kev 4B ahead |
| API-Bank · Decision Index 0.4.1 | 53.3 | 6.1 | Kev 4B ahead |
| SATA-Bench · Decision Index 0.4.1 | 28.8 | 5.6 | Kev 4B ahead |
| MMLU-Pro · Decision Index 0.4.1 | 50.7 | 14.7 | Kev 4B ahead |
| GSM8K · Decision Index 0.4.1 | 46.5 | 17.5 | Kev 4B ahead |
| BFCL · Decision Index 0.4.1 | 93.1 | 38.9 | Kev 4B ahead |
| New Yorker · Decision Index 0.4.1 | 52.3 | 25.4 | Kev 4B ahead |
| BBH · Decision Index 0.4.1 | 62.5 | 30.8 | Kev 4B ahead |
| BPoMP · Decision Index 0.4.1 | 65.1 | 32.9 | Kev 4B ahead |
| HellaSwag · Decision Index 0.4.1 | 78.9 | 40.4 | Kev 4B ahead |
| GPQA Diamond · Decision Index 0.4.1 | 37.8 | 20.4 | Kev 4B ahead |
| When2Call · Decision Index 0.4.1 | 66.7 | 38.7 | Kev 4B ahead |
| MuSR · Decision Index 0.4.1 | 56.3 | 34.6 | Kev 4B ahead |
| HLE · Decision Index 0.4.1 | 10.2 | 15.8 | CLM-v0.1-8B ahead |
| WinoGrande · Decision Index 0.4.1 | 70.2 | 50.8 | Kev 4B ahead |
| PhishNChips · Decision Index 0.4.1 | 55.3 | 65.1 | CLM-v0.1-8B ahead |
| CLadder · Decision Index 0.4.1 | 63.1 | 53.9 | Kev 4B ahead |
| HoVer · Decision Index 0.4.1 | 59.7 | 52.0 | Kev 4B ahead |
| cfcolor · Decision Index 0.4.1 | 57.9 | 50.8 | Kev 4B ahead |
| Habermas · Decision Index 0.4.1 | 42.0 | 37.1 | Kev 4B ahead |
| BANKING77 · Decision Index 0.4.1 | 82.9 | 6.5 | Kev 4B slightly ahead |
| CLINC150 · Decision Index 0.4.1 | 75.0 | 8.9 | Kev 4B slightly ahead |
| Amazon ESCI · Decision Index 0.4.1 | 39.7 | 5.0 | Kev 4B slightly ahead |
| ContractNLI · Decision Index 0.4.1 | 64.4 | 20.1 | Kev 4B slightly ahead |
| ACOS · Decision Index 0.4.1 | 9.8 | 3.1 | Kev 4B slightly ahead |
| FinEntity · Decision Index 0.4.1 | 87.1 | 33.4 | Kev 4B slightly ahead |
| VAST · Decision Index 0.4.1 | 52.4 | 22.7 | Kev 4B slightly ahead |
| ANLI · Decision Index 0.4.1 | 48.1 | 31.6 | Kev 4B slightly ahead |
| ToolRet · Decision Index 0.4.1 | 61.0 | 40.3 | Kev 4B slightly ahead |
| iSarcasmEval · Decision Index 0.4.1 | 46.8 | 31.2 | Kev 4B slightly ahead |
| BRIGHT · Decision Index 0.4.1 | 39.0 | 29.2 | Kev 4B slightly ahead |
| NLI4CT · Decision Index 0.4.1 | 74.6 | 56.5 | Kev 4B slightly ahead |
| RAGTruth · Decision Index 0.4.1 | 67.5 | 51.8 | Kev 4B slightly ahead |
| CRUXEval · Decision Index 0.4.1 | 48.1 | 42.8 | level |
| ChessBench · Decision Index 0.4.1 | 8.9 | 8.2 | level |
| Humicroedit · Decision Index 0.4.1 | 54.4 | 55.6 | level |
Source · latest October 28, 2026
All data side by side
| Kev 4B | CLM-v0.1-8B | |
|---|---|---|
| Kind | Adapter | Standalone |
| Developer | Jared Palmer | Contrastive-LM |
| Status | Open source | Open weights |
| Released | September 20, 2026 | n/a |
| Weights | open | open |
| Runs locally | yes | yes |
| Parameters | n/a | 8 B |
| License | Apache-2.0 for the adapter and head | Apache-2.0 |
| Popularity (out of 100) | 23 | 37 |