pplx-decider-v1-27b
Benchmark runShow test details
Decisions
Local · German, English
Execution Apple Metal. Precision BF16.
130 valid outputs from 130 attempted and 130 planned test slots.
Measured duration p50 / p95 1,616.5 / 2,101 ms (130 cases). Local GPU. Quantile calculation not documented.
- Automatic decision accuracy
- 96.67 %(58 / 60 planned cases)German, English
- Automatic decision accuracy, Triage
- 100 %(12 / 12 planned cases)German, English
- Automatic decision accuracy, Routing
- 100 %(12 / 12 planned cases)German, English
- Automatic decision accuracy, Selection with constraints
- 100 %(12 / 12 planned cases)German, English
- Automatic decision accuracy, Numbers and tables
- 83.33 %(10 / 12 planned cases)German, English
- Automatic decision accuracy, Sufficient evidence
- 100 %(12 / 12 planned cases)German, English
- Correct robustness variants
- 96.67 %(29 / 30 planned cases)German, English
- Correct development cases
- 100 %(40 / 40 planned cases)German, English
- Unnecessary reviews
- 0 %(0 / 52 assessable cases without a required review)German, English
- Missed required reviews
- 0 %(0 / 8 assessable cases requiring review)German, English