Loading benchmarks…
Automated translation metrics summarized for 334 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| French → PortugueseFR · French · Français→PT · Portuguese · Português | 171 | Mean 7.98 25th pct. 7.84 · Median 8.04 · 75th pct. 8.17 | Mean 0.845 25th pct. 0.843 · Median 0.846 · 75th pct. 0.847 | Mean 26.8 25th pct. 25.5 · Median 26.4 · 75th pct. 28.3 | Mean 33.2 25th pct. 32.5 · Median 33.2 · 75th pct. 34.1 | Mean 0.940 25th pct. 0.930 · Median 0.936 · 75th pct. 0.948 |
| Hindi → TurkishHI · Hindi · हिन्दी→TR · Turkish · Türkçe | 51 | Mean 7.68 25th pct. 6.91 · Median 7.95 · 75th pct. 8.21 | Mean 0.854 25th pct. 0.851 · Median 0.854 · 75th pct. 0.857 | Mean 15.3 25th pct. 13.8 · Median 14.8 · 75th pct. 17.3 | Mean 18.6 25th pct. 16.7 · Median 18.7 · 75th pct. 20.1 | Mean 0.723 25th pct. 0.695 · Median 0.722 · 75th pct. 0.753 |
| Hindi → VietnameseHI · Hindi · हिन्दी→VI · Vietnamese · Tiếng Việt | 171 | Mean 7.58 25th pct. 7.36 · Median 7.94 · 75th pct. 8.04 | Mean 0.854 25th pct. 0.851 · Median 0.854 · 75th pct. 0.858 | Mean 22.8 25th pct. 21.8 · Median 23.7 · 75th pct. 24.6 | Mean 26.9 25th pct. 25.8 · Median 27.1 · 75th pct. 29.1 | Mean 1.211 25th pct. 1.194 · Median 1.205 · 75th pct. 1.215 |
| French → EnglishFR · French · Français→EN · English | 9 | Mean 7.91 25th pct. 7.75 · Median 7.90 · 75th pct. 8.08 | Mean 0.846 25th pct. 0.844 · Median 0.846 · 75th pct. 0.847 | Mean 21.3 25th pct. 19.4 · Median 21.8 · 75th pct. 23.8 | Mean 25.3 25th pct. 23.6 · Median 25.8 · 75th pct. 27.5 | Mean 1.087 25th pct. 1.083 · Median 1.087 · 75th pct. 1.096 |
| Russian → EnglishRU · Russian · Русский→EN · English | 280 | Mean 7.81 25th pct. 7.34 · Median 7.85 · 75th pct. 8.29 | Mean 0.837 25th pct. 0.833 · Median 0.838 · 75th pct. 0.842 | Mean 23.0 25th pct. 19.1 · Median 23.3 · 75th pct. 26.7 | Mean 31.0 25th pct. 27.8 · Median 30.6 · 75th pct. 34.0 | Mean 1.251 25th pct. 1.241 · Median 1.251 · 75th pct. 1.264 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.