Loading benchmarks…
Automated translation metrics summarized for 334 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| English → KazakhEN · English→KK · Kazakh · Қазақша | 213 | Mean 6.07 25th pct. 5.54 · Median 5.96 · 75th pct. 6.51 | Mean 0.928 25th pct. 0.926 · Median 0.930 · 75th pct. 0.933 | Mean 9.3 25th pct. 8.4 · Median 9.4 · 75th pct. 10.0 | Mean 15.1 25th pct. 14.2 · Median 15.2 · 75th pct. 16.2 | Mean 0.845 25th pct. 0.822 · Median 0.834 · 75th pct. 0.861 |
| English → RomanianEN · English→RO · Romanian · Română | 316 | Mean 7.03 25th pct. 6.81 · Median 7.03 · 75th pct. 7.19 | Mean 0.926 25th pct. 0.924 · Median 0.928 · 75th pct. 0.929 | Mean 35.8 25th pct. 34.7 · Median 35.2 · 75th pct. 37.2 | Mean 44.6 25th pct. 43.1 · Median 44.5 · 75th pct. 46.0 | Mean 1.004 25th pct. 0.997 · Median 1.000 · 75th pct. 1.016 |
| English → ThaiEN · English→TH · Thai · ไทย | 1 | Mean 2.84 25th pct. 2.86 · Median 2.86 · 75th pct. 2.86 | Mean 0.937 25th pct. 0.922 · Median 0.925 · 75th pct. 0.956 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.198 25th pct. 0.170 · Median 0.170 · 75th pct. 0.198 |
| Mandarin Chinese → JapaneseZH · Mandarin Chinese · 普通话→JA · Japanese · 日本語 | 213 | Mean 2.45 25th pct. 2.21 · Median 2.51 · 75th pct. 2.71 | Mean 0.921 25th pct. 0.919 · Median 0.923 · 75th pct. 0.924 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.839 25th pct. 0.778 · Median 0.778 · 75th pct. 0.778 |
| Portuguese → RomanianPT · Portuguese · Português→RO · Romanian · Română | 79 | Mean 7.24 25th pct. 6.58 · Median 7.47 · 75th pct. 7.80 | Mean 0.918 25th pct. 0.911 · Median 0.922 · 75th pct. 0.923 | Mean 32.3 25th pct. 28.9 · Median 33.3 · 75th pct. 35.6 | Mean 44.1 25th pct. 41.8 · Median 44.5 · 75th pct. 46.2 | Mean 1.149 25th pct. 1.136 · Median 1.153 · 75th pct. 1.161 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.