Lev
Benchmark run- The exact base-model revision is not attested.
Show test details
Decisions
Local · German, English
Execution Apple Metal. Precision FP32.
130 valid outputs from 130 attempted and 130 planned test slots.
Measured duration p50 / p95 1,255 / 1,812 ms (130 cases). Local GPU. Quantile calculation not documented.
- Automatic decision accuracy
- 81.67 %(49 / 60 planned cases)German, English
- Automatic decision accuracy, Triage
- 58.33 %(7 / 12 planned cases)German, English
- Automatic decision accuracy, Routing
- 91.67 %(11 / 12 planned cases)German, English
- Automatic decision accuracy, Selection with constraints
- 91.67 %(11 / 12 planned cases)German, English
- Automatic decision accuracy, Numbers and tables
- 75 %(9 / 12 planned cases)German, English
- Automatic decision accuracy, Sufficient evidence
- 91.67 %(11 / 12 planned cases)German, English
- Correct robustness variants
- 83.33 %(25 / 30 planned cases)German, English
- Correct development cases
- 85 %(34 / 40 planned cases)German, English
- Unnecessary reviews
- 7.69 %(4 / 52 assessable cases without a required review)German, English
- Missed required reviews
- 12.5 %(1 / 8 assessable cases requiring review)German, English