Index-Homura-2B
Bilibili Index Team
- Released
- -
- Data date
- October 7, 2026
- Input
- Text, target syllable count, and optional glossary
- Output
- Translated text adjusted toward an approximate syllable count
Index-Homura-2B accepts a target syllable count for its translation. The model adjusts the wording toward that target, while a glossary can further guide word choice. The count remains approximate and does not guarantee a particular spoken duration.
Specifications and access
| Specification | Value and source |
|---|---|
| Model type | Open weightsSource |
| Model ID | IndexTeam/Index-Homura-2BSource |
| Model task | Text translation with a target syllable countSource |
| Access | Public Hugging Face weights for local executionSource |
| Input modalities | Text, target syllable count, and optional glossarySource |
| Output modalities | Translated text adjusted toward an approximate syllable countSource |
| License | Apache 2.0 according to the Hugging Face model cardSource |
| Syllable control | Adjusts wording toward a target syllable count; the count does not guarantee spoken durationSource |
| Parameters | 2 billionSource |
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
SandGlass / outputs within ±1 syllable (Show measurement, test conditions, and source)
- Source value
- 54.39
- Score
- 54.39
- Metric
- Share of cases within one syllable of the target
- Unit
- %
- Category
- translation
- Direction
- Higher is better
- Sample
- 3600
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact released RL checkpoint IndexTeam/Index-Homura-2B (not the separate SFT ablation). SandGlass: 300 subtitle sentences × 4 target languages × 3 requested length budgets = 3,600 cases. Local model evaluation used greedy decoding and a 512-token output limit. Gemini-2.5-Flash judged translation quality without references on a 0/0.5/1 scale; target counts derive from subtitle duration and language-specific speaking rates, with short/long targets at 0.75×/1.25×.
SandGlass / outputs within 10% of target (Show measurement, test conditions, and source)
- Source value
- 63.08
- Score
- 63.08
- Metric
- Share of cases within 10% of target syllable count
- Unit
- %
- Category
- translation
- Direction
- Higher is better
- Sample
- 3600
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact released RL checkpoint IndexTeam/Index-Homura-2B (not the separate SFT ablation). SandGlass: 300 subtitle sentences × 4 target languages × 3 requested length budgets = 3,600 cases. Local model evaluation used greedy decoding and a 512-token output limit. Gemini-2.5-Flash judged translation quality without references on a 0/0.5/1 scale; target counts derive from subtitle duration and language-specific speaking rates, with short/long targets at 0.75×/1.25×.
SandGlass / translation quality (Show measurement, test conditions, and source)
- Source value
- 0.7615
- Score
- 0.7615
- Metric
- Reference-free Gemini-2.5-Flash translation-quality mean
- Unit
- ratio
- Category
- translation
- Direction
- Higher is better
- Sample
- 3600
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact released RL checkpoint IndexTeam/Index-Homura-2B (not the separate SFT ablation). SandGlass: 300 subtitle sentences × 4 target languages × 3 requested length budgets = 3,600 cases. Local model evaluation used greedy decoding and a 512-token output limit. Gemini-2.5-Flash judged translation quality without references on a 0/0.5/1 scale; target counts derive from subtitle duration and language-specific speaking rates, with short/long targets at 0.75×/1.25×.
SandGlass / mean relative syllable-count deviation (Show measurement, test conditions, and source)
- Source value
- 0.0962
- Score
- 0.0962
- Metric
- Mean absolute syllable-count error divided by requested target count
- Unit
- ratio
- Category
- translation
- Direction
- Lower is better
- Sample
- 3600
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact released RL checkpoint IndexTeam/Index-Homura-2B (not the separate SFT ablation). SandGlass: 300 subtitle sentences × 4 target languages × 3 requested length budgets = 3,600 cases. Local model evaluation used greedy decoding and a 512-token output limit. Gemini-2.5-Flash judged translation quality without references on a 0/0.5/1 scale; target counts derive from subtitle duration and language-specific speaking rates, with short/long targets at 0.75×/1.25×.
SandGlass / official composite score (Show measurement, test conditions, and source)
- Source value
- 0.7937
- Score
- 0.7937
- Metric
- Vendor-labeled score; formula and scale not stated
- Unit
- No unit provided
- Category
- translation
- Direction
- Higher is better
- Sample
- 3600
- Source type
- vendor-reported
- Evaluator
- Bilibili Index-Translate official model site
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact released checkpoint IndexTeam/Index-Homura-2B; official site labels this as a SandGlass composite / syllable-reward result. Its displayed table does not define the score formula or a measurement unit; it is therefore recorded with unit unknown.
- Context
- Do not interpret this as a percentage or as the separate translation-quality score; the official table does not state the formula or unit.
SandGlass / official syllable reward (Show measurement, test conditions, and source)
- Source value
- 0.8259
- Score
- 0.8259
- Metric
- Vendor-labeled score; formula and scale not stated
- Unit
- No unit provided
- Category
- translation
- Direction
- Higher is better
- Sample
- 3600
- Source type
- vendor-reported
- Evaluator
- Bilibili Index-Translate official model site
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact released checkpoint IndexTeam/Index-Homura-2B; official site labels this as a SandGlass composite / syllable-reward result. Its displayed table does not define the score formula or a measurement unit; it is therefore recorded with unit unknown.
- Context
- Do not interpret this as a percentage or as the separate translation-quality score; the official table does not state the formula or unit.
Sources and data date
| Type | Evidence and data date |
|---|---|
| Input | Documented modalities. Retrieved October 7, 2026. |
| Output | Documented modalities. Retrieved October 7, 2026. |
| Research status | Research date October 7, 2026. 5 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication. |
| Unresolved | SandGlass control slope Original wording The report publishes a slope score but defines the ideal as approximately 1, so neither a monotone higher-is-better nor lower-is-better direction is correct for this schema; the value is deliberately not encoded as a ranked benchmark. |
| Not found in the inspected sources | independent exact-checkpoint reproduction Original wording The reviewed official cards, evaluation repository, and technical report provide vendor-reported results; they do not cite an independent reproduction of this exact RL checkpoint. |
| Not published | SandGlass target-language breakdown Original wording The checked versioned report and official site publish the per-language table for Index-Homura-9B only, not the exact 2B release checkpoint. |
| Not found in the inspected sources | SandGlass / outputs within 5% of target Original wording The checked official SandGlass leaderboard publishes the added within-5% rate only for the 9B RL entry. The technical report gives other 2B rates but no exact 2B value at this threshold. |
| Additional source | Bilibili Index-Translate repository (retrieved October 7, 2026) · Bilibili Index-Translate repository · Editorial description reviewed October 7, 2026 |
| Additional source | Bilibili IndexTeam technical report, Index-Translate (arXiv v1) (retrieved October 7, 2026) |
| Additional source | Bilibili Index-Translate official model site (retrieved October 7, 2026) |
| Additional source | Model metadata (retrieved October 7, 2026) |
| Additional source | Model metadata (retrieved October 7, 2026) |