Loading benchmarks…
Benchmark dashboard
Automated translation metrics summarized for 335 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| Spanish → EnglishES · Spanish · Español→EN · English | 43 | Median 8.41 Mean 7.45 · 25th pct. 7.87 · 75th pct. 8.84 | Mean 0.881 25th pct. 0.880 · Median 0.882 · 75th pct. 0.885 | Mean 50.8 25th pct. 48.7 · Median 50.5 · 75th pct. 53.5 | Mean 53.6 25th pct. 52.0 · Median 54.5 · 75th pct. 55.4 | Mean 1.158 25th pct. 1.149 · Median 1.169 · 75th pct. 1.173 |
| English → Modern Standard ArabicEN · English→AR · Modern Standard Arabic · العربية الفصحى | 300 | Median 4.87 Mean 4.14 · 25th pct. 3.80 · 75th pct. 5.00 | Mean 0.858 25th pct. 0.857 · Median 0.871 · 75th pct. 0.876 | Mean 51.4 25th pct. 40.7 · Median 49.3 · 75th pct. 62.5 | Mean 51.4 25th pct. 39.8 · Median 49.2 · 75th pct. 62.4 | Mean 0.917 25th pct. 0.907 · Median 0.907 · 75th pct. 0.930 |
| English → VietnameseEN · English→VI · Vietnamese · Tiếng Việt | 328 | Median 3.62 Mean 3.23 · 25th pct. 2.48 · 75th pct. 4.13 | Mean 0.895 25th pct. 0.908 · Median 0.912 · 75th pct. 0.915 | Mean 47.8 25th pct. 46.2 · Median 47.7 · 75th pct. 51.5 | Mean 51.0 25th pct. 50.0 · Median 51.0 · 75th pct. 54.1 | Mean 1.565 25th pct. 1.526 · Median 1.575 · 75th pct. 1.597 |
| Portuguese → EnglishPT · Portuguese · Português→EN · English | 87 | Median 7.94 Mean 7.17 · 25th pct. 7.31 · 75th pct. 8.38 | Mean 0.896 25th pct. 0.895 · Median 0.896 · 75th pct. 0.898 | Mean 41.6 25th pct. 39.8 · Median 41.3 · 75th pct. 44.6 | Mean 45.6 25th pct. 44.9 · Median 46.4 · 75th pct. 48.8 | Mean 1.213 25th pct. 1.206 · Median 1.209 · 75th pct. 1.222 |
| English → IndonesianEN · English→ID · Indonesian · Bahasa Indonesia | 329 | Median 3.57 Mean 3.29 · 25th pct. 3.16 · 75th pct. 4.11 | Mean 0.897 25th pct. 0.918 · Median 0.920 · 75th pct. 0.921 | Mean 41.0 25th pct. 37.9 · Median 39.8 · 75th pct. 46.5 | Mean 44.5 25th pct. 42.0 · Median 44.3 · 75th pct. 48.9 | Mean 1.010 25th pct. 0.992 · Median 1.005 · 75th pct. 1.025 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.