- Source value
- 49.3
- Metric
- Share of judged responses favoring symbolic planning, with ties retained
- Unit
- %
- Benchmark version
- YuE2 arXiv:2609.33757v1 Section 4.2, direct planning ablation
- Category
- audio
- Direction
- Higher is better
- Sample
- 211
- Source type
- vendor-reported
- Evaluator
- YuE2 paper authors, arXiv
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Vendor-reported result. Same exact YuE2 checkpoint, prompts, lyrics, two-candidate budget and waveform decoder. The planned condition first generates a melody-and-chord score; the unplanned condition generates semantic tokens and acoustic latents directly. The expert panel retained 211 judged overall-quality evaluations: 49.3% favored planning, 34.6% favored no planning and 16.1% were ties.
- Context
- This is an ablation of two generation modes within the same checkpoint, not a cross-model quality score. The preference share retains ties, so 50% is not the stated neutral threshold; the paper gives a significance test but no confidence interval in this section.