Loading benchmarks…
Benchmark dashboard
Automated translation metrics summarized for 335 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| French → VietnameseFR · French · Français→VI · Vietnamese · Tiếng Việt | 334 | Median 3.10 Mean 2.83 · 25th pct. 2.61 · 75th pct. 3.35 | Mean 0.868 25th pct. 0.865 · Median 0.874 · 75th pct. 0.882 | Mean 23.3 25th pct. 20.4 · Median 23.0 · 75th pct. 24.9 | Mean 29.2 25th pct. 28.1 · Median 29.5 · 75th pct. 31.3 | Mean 1.294 25th pct. 1.274 · Median 1.287 · 75th pct. 1.301 |
| Russian → Iranian Persian (Farsi)RU · Russian · Русский→FA · Iranian Persian (Farsi) · فارسی | 333 | Median 3.21 Mean 3.05 · 25th pct. 2.87 · 75th pct. 3.47 | Mean 0.853 25th pct. 0.855 · Median 0.865 · 75th pct. 0.874 | Mean 17.8 25th pct. 15.9 · Median 17.8 · 75th pct. 18.6 | Mean 23.1 25th pct. 22.8 · Median 24.3 · 75th pct. 24.9 | Mean 1.253 25th pct. 1.213 · Median 1.259 · 75th pct. 1.283 |
| Mandarin Chinese → ThaiZH · Mandarin Chinese · 普通话→TH · Thai · ไทย | 332 | Median 3.28 Mean 3.03 · 25th pct. 2.75 · 75th pct. 3.53 | Mean 0.553 25th pct. 0.546 · Median 0.556 · 75th pct. 0.567 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 2.456 25th pct. 2.222 · Median 2.444 · 75th pct. 2.722 |
| French → ThaiFR · French · Français→TH · Thai · ไทย | 331 | Median 3.40 Mean 3.21 · 25th pct. 2.86 · 75th pct. 3.92 | Mean 0.785 25th pct. 0.775 · Median 0.778 · 75th pct. 0.803 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.150 25th pct. 0.113 · Median 0.125 · 75th pct. 0.180 |
| English → Iranian Persian (Farsi)EN · English→FA · Iranian Persian (Farsi) · فارسی | 330 | Median 3.54 Mean 3.35 · 25th pct. 2.94 · 75th pct. 3.92 | Mean 0.885 25th pct. 0.889 · Median 0.898 · 75th pct. 0.902 | Mean 23.5 25th pct. 19.9 · Median 22.4 · 75th pct. 26.7 | Mean 24.3 25th pct. 20.9 · Median 23.3 · 75th pct. 26.8 | Mean 1.186 25th pct. 1.139 · Median 1.189 · 75th pct. 1.220 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.