Loading benchmarks…
Benchmark dashboard
Automated translation metrics summarized for 335 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| Mandarin Chinese → VietnameseZH · Mandarin Chinese · 普通话→VI · Vietnamese · Tiếng Việt | 324 | Median 4.01 Mean 3.72 · 25th pct. 3.65 · 75th pct. 4.49 | Mean 0.870 25th pct. 0.872 · Median 0.876 · 75th pct. 0.881 | Mean 36.9 25th pct. 35.6 · Median 38.1 · 75th pct. 39.5 | Mean 38.5 25th pct. 37.7 · Median 39.5 · 75th pct. 41.4 | Mean 50.573 25th pct. 50.167 · Median 50.889 · 75th pct. 51.000 |
| Mandarin Chinese → UzbekZH · Mandarin Chinese · 普通话→UZ · Uzbek · Oʻzbek | 172 | Median 7.14 Mean 6.09 · 25th pct. 6.17 · 75th pct. 7.57 | Mean 0.825 25th pct. 0.830 · Median 0.841 · 75th pct. 0.844 | Mean 5.6 25th pct. 4.6 · Median 5.6 · 75th pct. 6.7 | Mean 7.8 25th pct. 7.2 · Median 7.9 · 75th pct. 9.3 | Mean 5.538 25th pct. 5.440 · Median 5.512 · 75th pct. 5.657 |
| Mandarin Chinese → UrduZH · Mandarin Chinese · 普通话→UR · Urdu · اردو | 192 | Median 7.00 Mean 5.98 · 25th pct. 5.22 · 75th pct. 7.54 | Mean 0.744 25th pct. 0.728 · Median 0.751 · 75th pct. 0.761 | Mean 10.8 25th pct. 9.3 · Median 11.3 · 75th pct. 12.8 | Mean 12.4 25th pct. 11.5 · Median 13.0 · 75th pct. 14.2 | Mean 6.583 25th pct. 6.421 · Median 6.547 · 75th pct. 6.609 |
| Mandarin Chinese → UkrainianZH · Mandarin Chinese · 普通话→UK · Ukrainian · Українська | 239 | Median 6.65 Mean 5.95 · 25th pct. 6.01 · 75th pct. 7.30 | Mean 0.840 25th pct. 0.853 · Median 0.861 · 75th pct. 0.866 | Mean 6.1 25th pct. 5.1 · Median 6.2 · 75th pct. 7.0 | Mean 9.1 25th pct. 8.3 · Median 9.5 · 75th pct. 10.3 | Mean 5.654 25th pct. 5.569 · Median 5.648 · 75th pct. 5.691 |
| Mandarin Chinese → TurkishZH · Mandarin Chinese · 普通话→TR · Turkish · Türkçe | 310 | Median 4.36 Mean 4.00 · 25th pct. 3.87 · 75th pct. 4.53 | Mean 0.852 25th pct. 0.849 · Median 0.853 · 75th pct. 0.858 | Mean 8.9 25th pct. 7.7 · Median 9.1 · 75th pct. 9.9 | Mean 10.5 25th pct. 9.0 · Median 10.7 · 75th pct. 11.9 | Mean 27.655 25th pct. 27.278 · Median 27.778 · 75th pct. 28.222 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.