Language modelPreview
Index-Translate-35B-A3B Preview
Bilibili Index Team
- Released
- September 30, 2026
- Data date
- October 7, 2026
- Input
- Text and translation instructions
- Output
- Translated text
Index-Translate-35B-A3B Preview is the translation family's MoE variant, activating 3 billion parameters per token according to its model card. It is the only variant Bilibili also offers through a free public API, available since October 4, 2026; its weights can be downloaded too.
Specifications and access
| Specification | Value and source |
|---|---|
| Model type | Open weightsSource |
| Model ID | IndexTeam/Index-Translate-35B-A3B-previewSource |
| Model task | Mixture-of-experts model for text translationSource |
| Access | Public Hugging Face weights for local execution and free Bilibili APISource |
| Input modalities | Text and translation instructionsSource |
| Output modalities | Translated textSource |
| License | Apache 2.0 according to the Hugging Face model cardSource |
| Release | Public weights released on September 30, 2026Source |
| Languages | Text translation across 150 languagesSource |
| API model ID | Index-Translate-35B-A3BSource |
| API availability | Free public API available since October 4, 2026Source |
| Parameter count | Model-card text: 35 billion total and 3 billion active; Hugging Face metadata: 36 billionSource |
Page 1 of 2
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
FLORES_minor_pair / off-target rate (Show measurement, test conditions, and source)
- Source value
- 2.4
- Score
- 2.4
- Metric
- Share of outputs in a language other than the requested target language
- Unit
- %
- Category
- translation
- Direction
- Lower is better
- Sample
- 104000
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. Exact checkpoint is the 35B-A3B preview; report setup: greedy text-translation decoding, 16,384-token context. Same FLORES low-resource devtest: 104,000 inputs across 1,040 directions among 62 languages. Lower is better.
- Context
- The 35B-A3B values are explicitly preview results.
instTrans_minor / off-target rate (Show measurement, test conditions, and source)
- Source value
- 4.05
- Score
- 4.05
- Metric
- Share of outputs in a language other than the requested target language
- Unit
- %
- Category
- translation
- Direction
- Lower is better
- Sample
- 2793
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. Exact checkpoint is the 35B-A3B preview; report setup: greedy text-translation decoding, 16,384-token context. Low-resource instruction-translation set: 2,793 tasks from Chinese or English into low-resource languages. Lower is better.
- Context
- The 35B-A3B values are explicitly preview results.
C-Eval / answer accuracy (Show measurement, test conditions, and source)
- Source value
- 77.6
- Score
- 77.6
- Metric
- Answer accuracy
- Unit
- %
- Category
- translation
- Direction
- Higher is better
- Sample
- 12342
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact model version corresponding to IndexTeam/Index-Translate-35B-A3B-preview. 12,342 labeled test questions across 52 subjects; matched evaluation subset; answer accuracy. The report does not specify a prompt template or decoding parameters for these general-capability runs.
- Context
- The 35B-A3B value belongs to the preview checkpoint.
GPQA-Diamond / answer accuracy (Show measurement, test conditions, and source)
- Source value
- 49.1
- Score
- 49.1
- Metric
- Answer accuracy
- Unit
- %
- Category
- translation
- Direction
- Higher is better
- Sample
- 198
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact model version corresponding to IndexTeam/Index-Translate-35B-A3B-preview. All 198 GPQA-Diamond questions; matched evaluation subset; answer accuracy. The report does not specify a prompt template or decoding parameters for these general-capability runs.
- Context
- The 35B-A3B value belongs to the preview checkpoint.
INCLUDE / answer accuracy (Show measurement, test conditions, and source)
- Source value
- 68.8
- Score
- 68.8
- Metric
- Answer accuracy
- Unit
- %
- Category
- translation
- Direction
- Higher is better
- Sample
- 22639
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact model version corresponding to IndexTeam/Index-Translate-35B-A3B-preview. 22,639 questions in 44 languages; matched subset; sample-level averaging for the multilingual set. The report does not specify a prompt template or decoding parameters for these general-capability runs.
- Context
- The 35B-A3B value belongs to the preview checkpoint.
MMMLU / answer accuracy (Show measurement, test conditions, and source)
- Source value
- 71.9
- Score
- 71.9
- Metric
- Answer accuracy
- Unit
- %
- Category
- translation
- Direction
- Higher is better
- Sample
- 4200
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact model version corresponding to IndexTeam/Index-Translate-35B-A3B-preview. 4,200 questions: 300 per language across 14 languages; sampling seed 42; matched subset. The report does not specify a prompt template or decoding parameters for these general-capability runs.
- Context
- The 35B-A3B value belongs to the preview checkpoint.
FLORES-200 / COMET-22 (Show measurement, test conditions, and source)
- Source value
- 0.8794
- Score
- 0.8794
- Metric
- COMET-22
- Unit
- ratio
- Category
- translation
- Direction
- Higher is better
- Sample
- 126000
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. The exact evaluated model is the released 35B-A3B preview checkpoint; it is not a finalized 35B model. The report uses greedy text-translation decoding and a 16,384-token context, except for the separately configured WMT26 run. 126,000 directions/items: 420 directions among 21 languages, devtest, 300 per direction.
- Context
- The 35B-A3B values are explicitly preview results.
WMT24++ / COMET-22 (Show measurement, test conditions, and source)
- Source value
- 0.8586
- Score
- 0.8586
- Metric
- COMET-22
- Unit
- ratio
- Category
- translation
- Direction
- Higher is better
- Sample
- 6000
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. The exact evaluated model is the released 35B-A3B preview checkpoint; it is not a finalized 35B model. The report uses greedy text-translation decoding and a 16,384-token context, except for the separately configured WMT26 run. English→20 languages, test split, 300 examples per direction.
- Context
- The 35B-A3B values are explicitly preview results.
WMT26 / GPT-5.6-Sol judge (Show measurement, test conditions, and source)
- Source value
- 76.76
- Score
- 76.76
- Metric
- Reference-free judge score, 0–100 points
- Unit
- points
- Category
- translation
- Direction
- Higher is better
- Sample
- 4897
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. The exact evaluated model is the released 35B-A3B preview checkpoint; it is not a finalized 35B model. The report uses greedy text-translation decoding and a 16,384-token context, except for the separately configured WMT26 run. 23 directions covering 20 target languages; zero-shot Chinese instructions; 3,584-token context and 1,536-token output limit; GPT-5.6-Sol reference-free judgments averaged over 20 target languages.
- Context
- The 35B-A3B values are explicitly preview results.
instTrans / translation quality (Show measurement, test conditions, and source)
- Source value
- 0.6901
- Score
- 0.6901
- Metric
- GPT-5.6-Sol translation-quality judgment, mean on 0/0.5/1 rubric
- Unit
- ratio
- Category
- translation
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. The exact evaluated model is the released 35B-A3B preview checkpoint; it is not a finalized 35B model. The report uses greedy text-translation decoding and a 16,384-token context, except for the separately configured WMT26 run. Core instruction-translation set: 3,000 Chinese→20-language tasks. Quality uses three GPT-5.6-Sol judge calls per example on a 0/0.5/1 rubric. Valid judgments: 2B 2,961; 9B 2,960; the report does not state a valid-judgment count for the 35B-A3B preview.
- Context
- The 35B-A3B values are explicitly preview results.
instTrans / IFscore (Show measurement, test conditions, and source)
- Source value
- 0.8336
- Score
- 0.8336
- Metric
- Instruction-following IFscore, 0–1
- Unit
- ratio
- Category
- translation
- Direction
- Higher is better
- Sample
- 3000
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. The exact evaluated model is the released 35B-A3B preview checkpoint; it is not a finalized 35B model. The report uses greedy text-translation decoding and a 16,384-token context, except for the separately configured WMT26 run. Core instruction-translation set: 3,000 Chinese→20-language tasks. IFscore gates the mean soft-constraint score by hard-constraint checks; the source does not publish a separate count of valid IFscore judgments.
- Context
- The 35B-A3B values are explicitly preview results.
IFMTBench / XCOMET-XXL (Show measurement, test conditions, and source)
- Source value
- 0.7926
- Score
- 0.7926
- Metric
- Reference-based XCOMET-XXL
- Unit
- ratio
- Category
- translation
- Direction
- Higher is better
- Sample
- 7064
- Source type
- vendor-reported
- Evaluator
- Bilibili IndexTeam technical report, Index-Translate (arXiv v1)
- Status
- active
- Retrieved at
- 2026-10-07
- Methodology
- Vendor-reported result. Exact evaluated checkpoint: IndexTeam/Index-Translate-35B-A3B-preview. The exact evaluated model is the released 35B-A3B preview checkpoint; it is not a finalized 35B model. The report uses greedy text-translation decoding and a 16,384-token context, except for the separately configured WMT26 run. Cleaned IFMTBench translation-instruction inputs; the report retains 7,064 inputs after preprocessing. The translation metric is reference-based XCOMET-XXL.
- Context
- The 35B-A3B values are explicitly preview results.
Page 1 of 2
Sources and data date
| Type | Evidence and data date |
|---|---|
| Input | Documented modalities. Retrieved October 7, 2026. |
| Output | Documented modalities. Retrieved October 7, 2026. |
| Research status | Research date October 7, 2026. 5 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication. |
| Not published | OpenSubtitles / COMET-22 Original wording The official raw score CSV has an empty OpenSubtitles_COMET22 cell for the 35B-A3B row; no score is published there for this preview checkpoint. |
| Not published | finalized 35B-A3B checkpoint Original wording The reviewed evaluation identifies this model as a preview; results for a later finalized checkpoint are not included or inferred. |
| Not published | instruction constraint breakdowns Original wording The technical report gives detailed IFMTBench and selected instTrans constraint breakdowns for final 2B/9B only; it does not publish exact constraint-row scores for this 35B-A3B preview checkpoint. |
| Not found in the inspected sources | independent exact-checkpoint reproduction Original wording The reviewed official cards, evaluation repository, and technical report provide vendor-reported results; they do not cite an independent reproduction of this exact checkpoint. |
| Additional source | Bilibili Index-Translate repository (retrieved October 7, 2026) · Bilibili Index-Translate repository and API notes · Editorial description reviewed October 7, 2026 |
| Additional source | Bilibili IndexTeam technical report, Index-Translate (arXiv v1) (retrieved October 7, 2026) |
| Additional source | Model metadata (retrieved October 7, 2026) |
| Additional source | Model metadata (retrieved October 7, 2026) |