Convai InnovationsSupersonic LabsDecision matchup
Layavs.Julia 1
Which model makes better decisions?
Laya and Julia 1 each lead in different tests.
Independent testsJev Decision Index
Laya0 of 1
Julia 10 of 1
Popularityout of 100
Laya0
Julia 1ahead39
Weights and access
Layaopen, local
Julia 1open, local
SizeParameters
Laya0.42 B
Julia 1smaller0.14 B
Pick Laya for
No clear edge
Pick Julia 1 for
smallermore popular
Shared tests
Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.
Jev Decision Index
depends on the subtestLaya is clearly ahead in 5 of 37 subtests and slightly in 7, Julia 1 in 4 clearly and slightly in 6. 15 are level.
POP909 · Decision Index 0.4.1
Laya5.1
Julia 10.2
2,000 tasks, as of October 28, 2026
SATA-Bench · Decision Index 0.4.1
Laya0.3
Julia 11.0
1,650 tasks, as of October 28, 2026
When2Call · Decision Index 0.4.1
Laya11.9
Julia 123.6
3,652 tasks, as of October 28, 2026
Show all 37 subtests
| Subtest | Laya | Julia 1 | Verdict |
|---|---|---|---|
| POP909 · Decision Index 0.4.1 | 5.1 | 0.2 | Laya ahead |
| SATA-Bench · Decision Index 0.4.1 | 0.3 | 1.0 | Julia 1 ahead |
| When2Call · Decision Index 0.4.1 | 11.9 | 23.6 | Julia 1 ahead |
| API-Bank · Decision Index 0.4.1 | 11.5 | 18.3 | Julia 1 ahead |
| HellaSwag · Decision Index 0.4.1 | 33.1 | 29.9 | Laya ahead |
| HoVer · Decision Index 0.4.1 | 55.8 | 50.3 | Laya ahead |
| MMLU-Pro · Decision Index 0.4.1 | 13.6 | 14.7 | Julia 1 ahead |
| BPoMP · Decision Index 0.4.1 | 51.6 | 48.8 | Laya ahead |
| CLadder · Decision Index 0.4.1 | 52.9 | 50.2 | Laya ahead |
| CLINC150 · Decision Index 0.4.1 | 3.2 | 12.3 | Julia 1 slightly ahead |
| BANKING77 · Decision Index 0.4.1 | 14.3 | 42.6 | Julia 1 slightly ahead |
| iSarcasmEval · Decision Index 0.4.1 | 14.9 | 6.5 | Laya slightly ahead |
| BRIGHT · Decision Index 0.4.1 | 19.9 | 9.1 | Laya slightly ahead |
| FinEntity · Decision Index 0.4.1 | 61.0 | 32.8 | Laya slightly ahead |
| ANLI · Decision Index 0.4.1 | 48.7 | 28.6 | Laya slightly ahead |
| VAST · Decision Index 0.4.1 | 40.5 | 32.9 | Laya slightly ahead |
| Amazon ESCI · Decision Index 0.4.1 | 24.4 | 20.6 | Laya slightly ahead |
| ACOS · Decision Index 0.4.1 | 3.5 | 3.1 | Laya slightly ahead |
| ContractNLI · Decision Index 0.4.1 | 29.0 | 31.8 | Julia 1 slightly ahead |
| RAGTruth · Decision Index 0.4.1 | 48.8 | 52.0 | Julia 1 slightly ahead |
| ToolRet · Decision Index 0.4.1 | 12.8 | 13.6 | Julia 1 slightly ahead |
| NLI4CT · Decision Index 0.4.1 | 47.7 | 49.7 | Julia 1 slightly ahead |
| New Yorker · Decision Index 0.4.1 | 27.1 | 23.5 | level |
| MuSR · Decision Index 0.4.1 | 43.2 | 39.0 | level |
| GPQA Diamond · Decision Index 0.4.1 | 27.6 | 25.5 | level |
| Habermas · Decision Index 0.4.1 | 33.4 | 35.4 | level |
| CRUXEval · Decision Index 0.4.1 | 40.2 | 38.1 | level |
| cfcolor · Decision Index 0.4.1 | 52.3 | 50.4 | level |
| HLE · Decision Index 0.4.1 | 14.0 | 14.4 | level |
| Humicroedit · Decision Index 0.4.1 | 47.2 | 48.3 | level |
| ChessBench · Decision Index 0.4.1 | 7.7 | 7.5 | level |
| BFCL · Decision Index 0.4.1 | 38.1 | 37.5 | level |
| BBH · Decision Index 0.4.1 | 34.1 | 33.8 | level |
| PhishNChips · Decision Index 0.4.1 | 50.1 | 49.9 | level |
| WinoGrande · Decision Index 0.4.1 | 50.5 | 50.7 | level |
| GSM8K · Decision Index 0.4.1 | 16.9 | 16.9 | level |
| Home appliances · Decision Index 0.4.1 | 0.0 | 0.0 | level |
Source · latest October 28, 2026