Loading benchmarks…
Benchmark dashboard
Automated translation metrics summarized for 335 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| Modern Standard Arabic → JapaneseAR · Modern Standard Arabic · العربية الفصحى→JA · Japanese · 日本語 | 58 | Median 8.25 Mean 7.06 · 25th pct. 7.76 · 75th pct. 8.70 | Mean 0.822 25th pct. 0.818 · Median 0.826 · 75th pct. 0.833 | Mean 0.3 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 1.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.7 | Mean 0.124 25th pct. 0.118 · Median 0.118 · 75th pct. 0.132 |
| Modern Standard Arabic → Yue Chinese (Cantonese)AR · Modern Standard Arabic · العربية الفصحى→YUE · Yue Chinese (Cantonese) · 粵語 | 7 | Median 8.82 Mean 7.36 · 25th pct. 7.38 · 75th pct. 9.08 | Mean 0.299 25th pct. 0.297 · Median 0.299 · 75th pct. 0.302 | Mean 0.1 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.3 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.189 25th pct. 0.170 · Median 0.186 · 75th pct. 0.210 |
| Modern Standard Arabic → Mandarin ChineseAR · Modern Standard Arabic · العربية الفصحى→ZH · Mandarin Chinese · 普通话 | 103 | Median 7.82 Mean 6.45 · 25th pct. 6.56 · 75th pct. 8.04 | Mean 0.700 25th pct. 0.692 · Median 0.708 · 75th pct. 0.719 | Mean 0.1 25th pct. 0.0 · Median 0.0 · 75th pct. 0.1 | Mean 0.7 25th pct. 0.6 · Median 0.7 · 75th pct. 0.7 | Mean 0.037 25th pct. 0.033 · Median 0.033 · 75th pct. 0.036 |
| English → ThaiEN · English→TH · Thai · ไทย | 298 | Median 5.00 Mean 4.98 · 25th pct. 5.00 · 75th pct. 5.00 | Mean 0.939 25th pct. 0.922 · Median 0.931 · 75th pct. 0.957 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.0 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 0.199 25th pct. 0.170 · Median 0.170 · 75th pct. 0.225 |
| English → Yue Chinese (Cantonese)EN · English→YUE · Yue Chinese (Cantonese) · 粵語 | 292 | Median 5.73 Mean 5.27 · 25th pct. 4.96 · 75th pct. 6.77 | Mean 0.607 25th pct. 0.594 · Median 0.610 · 75th pct. 0.621 | Mean 0.2 25th pct. 0.0 · Median 0.0 · 75th pct. 0.0 | Mean 1.1 25th pct. 0.0 · Median 1.5 · 75th pct. 1.6 | Mean 0.258 25th pct. 0.222 · Median 0.240 · 75th pct. 0.257 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.