MapikaContrastive-LMDecision matchup
Decider 35B A3B NVFP4vs.CLM-v0.1-8B
Which model makes better decisions?
Decider 35B A3B NVFP4 does better in independent tests, while CLM-v0.1-8B is much smaller.
Independent testsJev Decision Index
Decider 35B A3B NVFP4ahead1 of 1
CLM-v0.1-8B0 of 1
Popularityout of 100
Decider 35B A3B NVFP40
CLM-v0.1-8Bahead37
Weights and access
Decider 35B A3B NVFP4open, local
CLM-v0.1-8Bopen, local
SizeParameters
Decider 35B A3B NVFP435 B
CLM-v0.1-8Bsmaller8 B
Pick Decider 35B A3B NVFP4 for
Jev Decision Index
Pick CLM-v0.1-8B for
smallermore popular
Shared tests
Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.
Jev Decision Index
Decider 35B A3B NVFP4 aheadDecider 35B A3B NVFP4 is clearly ahead in 22 of 37 subtests and slightly in 13, CLM-v0.1-8B in 1. 1 is level.
Home appliances · Decision Index 0.4.1
Decider 35B A3B NVFP423.9
CLM-v0.1-8B0.0
88 tasks, as of October 28, 2026
POP909 · Decision Index 0.4.1
Decider 35B A3B NVFP46.7
CLM-v0.1-8B0.0
2,000 tasks, as of October 28, 2026
API-Bank · Decision Index 0.4.1
Decider 35B A3B NVFP456.5
CLM-v0.1-8B6.1
508 tasks, as of October 28, 2026
Show all 37 subtests
| Subtest | Decider 35B A3B NVFP4 | CLM-v0.1-8B | Verdict |
|---|---|---|---|
| Home appliances · Decision Index 0.4.1 | 23.9 | 0.0 | Decider 35B A3B NVFP4 ahead |
| POP909 · Decision Index 0.4.1 | 6.7 | 0.0 | Decider 35B A3B NVFP4 ahead |
| API-Bank · Decision Index 0.4.1 | 56.5 | 6.1 | Decider 35B A3B NVFP4 ahead |
| SATA-Bench · Decision Index 0.4.1 | 34.7 | 5.6 | Decider 35B A3B NVFP4 ahead |
| MMLU-Pro · Decision Index 0.4.1 | 60.5 | 14.7 | Decider 35B A3B NVFP4 ahead |
| BPoMP · Decision Index 0.4.1 | 89.1 | 32.9 | Decider 35B A3B NVFP4 ahead |
| New Yorker · Decision Index 0.4.1 | 64.0 | 25.4 | Decider 35B A3B NVFP4 ahead |
| HellaSwag · Decision Index 0.4.1 | 96.7 | 40.4 | Decider 35B A3B NVFP4 ahead |
| GSM8K · Decision Index 0.4.1 | 41.5 | 17.5 | Decider 35B A3B NVFP4 ahead |
| BFCL · Decision Index 0.4.1 | 92.2 | 38.9 | Decider 35B A3B NVFP4 ahead |
| BBH · Decision Index 0.4.1 | 71.3 | 30.8 | Decider 35B A3B NVFP4 ahead |
| GPQA Diamond · Decision Index 0.4.1 | 40.8 | 20.4 | Decider 35B A3B NVFP4 ahead |
| HLE · Decision Index 0.4.1 | 8.8 | 15.8 | CLM-v0.1-8B ahead |
| MuSR · Decision Index 0.4.1 | 61.8 | 34.6 | Decider 35B A3B NVFP4 ahead |
| WinoGrande · Decision Index 0.4.1 | 88.6 | 50.8 | Decider 35B A3B NVFP4 ahead |
| When2Call · Decision Index 0.4.1 | 59.7 | 38.7 | Decider 35B A3B NVFP4 ahead |
| CRUXEval · Decision Index 0.4.1 | 59.8 | 42.8 | Decider 35B A3B NVFP4 ahead |
| ChessBench · Decision Index 0.4.1 | 10.9 | 8.2 | Decider 35B A3B NVFP4 ahead |
| cfcolor · Decision Index 0.4.1 | 64.9 | 50.8 | Decider 35B A3B NVFP4 ahead |
| Habermas · Decision Index 0.4.1 | 46.4 | 37.1 | Decider 35B A3B NVFP4 ahead |
| CLadder · Decision Index 0.4.1 | 66.7 | 53.9 | Decider 35B A3B NVFP4 ahead |
| HoVer · Decision Index 0.4.1 | 63.5 | 52.0 | Decider 35B A3B NVFP4 ahead |
| Humicroedit · Decision Index 0.4.1 | 62.0 | 55.6 | Decider 35B A3B NVFP4 ahead |
| BANKING77 · Decision Index 0.4.1 | 89.8 | 6.5 | Decider 35B A3B NVFP4 slightly ahead |
| CLINC150 · Decision Index 0.4.1 | 94.7 | 8.9 | Decider 35B A3B NVFP4 slightly ahead |
| Amazon ESCI · Decision Index 0.4.1 | 50.6 | 5.0 | Decider 35B A3B NVFP4 slightly ahead |
| ACOS · Decision Index 0.4.1 | 27.2 | 3.1 | Decider 35B A3B NVFP4 slightly ahead |
| ContractNLI · Decision Index 0.4.1 | 75.0 | 20.1 | Decider 35B A3B NVFP4 slightly ahead |
| FinEntity · Decision Index 0.4.1 | 85.2 | 33.4 | Decider 35B A3B NVFP4 slightly ahead |
| VAST · Decision Index 0.4.1 | 54.5 | 22.7 | Decider 35B A3B NVFP4 slightly ahead |
| ANLI · Decision Index 0.4.1 | 66.0 | 31.6 | Decider 35B A3B NVFP4 slightly ahead |
| iSarcasmEval · Decision Index 0.4.1 | 54.8 | 31.2 | Decider 35B A3B NVFP4 slightly ahead |
| ToolRet · Decision Index 0.4.1 | 66.3 | 40.3 | Decider 35B A3B NVFP4 slightly ahead |
| BRIGHT · Decision Index 0.4.1 | 41.7 | 29.2 | Decider 35B A3B NVFP4 slightly ahead |
| NLI4CT · Decision Index 0.4.1 | 78.5 | 56.5 | Decider 35B A3B NVFP4 slightly ahead |
| RAGTruth · Decision Index 0.4.1 | 63.1 | 51.8 | Decider 35B A3B NVFP4 slightly ahead |
| PhishNChips · Decision Index 0.4.1 | 66.9 | 65.1 | level |
Source · latest October 28, 2026
All data side by side
| Decider 35B A3B NVFP4 | CLM-v0.1-8B | |
|---|---|---|
| Kind | Standalone | Standalone |
| Developer | Mapika | Contrastive-LM |
| Status | Open source | Open weights |
| Weights | open | open |
| Runs locally | yes | yes |
| Parameters | 35 B | 8 B |
| License | Apache-2.0 | Apache-2.0 |
| Popularity (out of 100) | 0 | 37 |