MapikaSupersonic LabsDecision matchup
Decider 4Bvs.Julia 1
Which model makes better decisions?
Decider 4B does better in independent tests, while Julia 1 is much smaller.
Pick Decider 4B for
Pick Julia 1 for
Shared tests
Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.
Jev Decision Index
Decider 4B aheadDecider 4B is clearly ahead in 22 of 37 subtests and slightly in 12, Julia 1 in none. 3 are level.
Home appliances · Decision Index 0.4.1
88 tasks, as of October 28, 2026
POP909 · Decision Index 0.4.1
2,000 tasks, as of October 28, 2026
SATA-Bench · Decision Index 0.4.1
1,650 tasks, as of October 28, 2026
Show all 37 subtests
| Subtest | Decider 4B | Julia 1 | Verdict |
|---|---|---|---|
| Home appliances · Decision Index 0.4.1 | 17.1 | 0.0 | Decider 4B ahead |
| POP909 · Decision Index 0.4.1 | 10.0 | 0.2 | Decider 4B ahead |
| SATA-Bench · Decision Index 0.4.1 | 31.6 | 1.0 | Decider 4B ahead |
| MMLU-Pro · Decision Index 0.4.1 | 51.7 | 14.7 | Decider 4B ahead |
| API-Bank · Decision Index 0.4.1 | 60.4 | 18.3 | Decider 4B ahead |
| When2Call · Decision Index 0.4.1 | 75.9 | 23.6 | Decider 4B ahead |
| HellaSwag · Decision Index 0.4.1 | 94.0 | 29.9 | Decider 4B ahead |
| New Yorker · Decision Index 0.4.1 | 62.9 | 23.5 | Decider 4B ahead |
| GSM8K · Decision Index 0.4.1 | 40.6 | 16.9 | Decider 4B ahead |
| BFCL · Decision Index 0.4.1 | 88.0 | 37.5 | Decider 4B ahead |
| BBH · Decision Index 0.4.1 | 60.9 | 33.8 | Decider 4B ahead |
| BPoMP · Decision Index 0.4.1 | 83.4 | 48.8 | Decider 4B ahead |
| GPQA Diamond · Decision Index 0.4.1 | 41.3 | 25.5 | Decider 4B ahead |
| WinoGrande · Decision Index 0.4.1 | 80.7 | 50.7 | Decider 4B ahead |
| ChessBench · Decision Index 0.4.1 | 10.5 | 7.5 | Decider 4B ahead |
| MuSR · Decision Index 0.4.1 | 53.7 | 39.0 | Decider 4B ahead |
| CLadder · Decision Index 0.4.1 | 63.3 | 50.2 | Decider 4B ahead |
| Humicroedit · Decision Index 0.4.1 | 59.7 | 48.3 | Decider 4B ahead |
| cfcolor · Decision Index 0.4.1 | 60.5 | 50.4 | Decider 4B ahead |
| PhishNChips · Decision Index 0.4.1 | 57.8 | 49.9 | Decider 4B ahead |
| Habermas · Decision Index 0.4.1 | 40.6 | 35.4 | Decider 4B ahead |
| HoVer · Decision Index 0.4.1 | 56.3 | 50.3 | Decider 4B ahead |
| CLINC150 · Decision Index 0.4.1 | 86.6 | 12.3 | Decider 4B slightly ahead |
| iSarcasmEval · Decision Index 0.4.1 | 42.1 | 6.5 | Decider 4B slightly ahead |
| ACOS · Decision Index 0.4.1 | 19.2 | 3.1 | Decider 4B slightly ahead |
| BRIGHT · Decision Index 0.4.1 | 45.5 | 9.1 | Decider 4B slightly ahead |
| ToolRet · Decision Index 0.4.1 | 65.0 | 13.6 | Decider 4B slightly ahead |
| FinEntity · Decision Index 0.4.1 | 86.0 | 32.8 | Decider 4B slightly ahead |
| ContractNLI · Decision Index 0.4.1 | 72.3 | 31.8 | Decider 4B slightly ahead |
| Amazon ESCI · Decision Index 0.4.1 | 42.4 | 20.6 | Decider 4B slightly ahead |
| ANLI · Decision Index 0.4.1 | 56.4 | 28.6 | Decider 4B slightly ahead |
| BANKING77 · Decision Index 0.4.1 | 74.7 | 42.6 | Decider 4B slightly ahead |
| VAST · Decision Index 0.4.1 | 53.5 | 32.9 | Decider 4B slightly ahead |
| NLI4CT · Decision Index 0.4.1 | 73.7 | 49.7 | Decider 4B slightly ahead |
| HLE · Decision Index 0.4.1 | 10.4 | 14.4 | level |
| CRUXEval · Decision Index 0.4.1 | 43.7 | 38.1 | level |
| RAGTruth · Decision Index 0.4.1 | 52.2 | 52.0 | level |
Source · latest October 28, 2026
DecideBench
Decider 4B aheadDecider 4B is clearly ahead in 10 of 10 subtests, Julia 1 in none.
DecideBench pair accuracy
200 tasks, as of October 18, 2026
DecideBench review_sentiment accuracy
50 tasks, as of October 18, 2026
DecideBench claim_support accuracy
50 tasks, as of October 18, 2026
Show all 10 subtests
| Subtest | Decider 4B | Julia 1 | Verdict |
|---|---|---|---|
| DecideBench pair accuracy | 78.5 % | 8.0 % | Decider 4B ahead |
| DecideBench review_sentiment accuracy | 88.0 % | 22.0 % | Decider 4B ahead |
| DecideBench claim_support accuracy | 90.0 % | 24.0 % | Decider 4B ahead |
| DecideBench returns_policy accuracy | 82.0 % | 28.0 % | Decider 4B ahead |
| DecideBench overall accuracy | 88.5 % | 34.8 % | Decider 4B ahead |
| DecideBench ticket_triage accuracy | 86.0 % | 34.0 % | Decider 4B ahead |
| DecideBench agent_routing accuracy | 96.0 % | 40.0 % | Decider 4B ahead |
| DecideBench content_moderation accuracy | 86.0 % | 38.0 % | Decider 4B ahead |
| DecideBench action_review accuracy | 82.0 % | 38.0 % | Decider 4B ahead |
| DecideBench support_intent accuracy | 98.0 % | 54.0 % | Decider 4B ahead |
Source · latest October 18, 2026
All data side by side
| Decider 4B | Julia 1 | |
|---|---|---|
| Kind | Standalone | Classifier |
| Developer | Mapika | Supersonic Labs |
| Status | Open source | Open source |
| Weights | open | open |
| Runs locally | yes | yes |
| Parameters | 4 B | 0.14 B |
| License | Apache-2.0 | Apache-2.0 |
| Popularity (out of 100) | 43 | 39 |