Loading benchmarks…
Benchmark dashboard
Automated translation metrics summarized for 335 language directions.
Sources — Source segments come from curated, public-facing parallel corpora and benchmark-style collections mixed for broad coverage. They are not model-generated: originals and references are assembled upstream as parallel text only; this dashboard does not redistribute raw corpora.
Mixed parallel corpora — Parallel segments spanning diverse genres and corpus scales. Each item includes a reference translation that is certified and human-verified—not produced by the models being benchmarked.
Language pairi | Rankingi | Fluencyi | COMETi | BLEUi | sacreBLEUi | Len ratioi |
|---|---|---|---|---|---|---|
| Modern Standard Arabic → AmharicAR · Modern Standard Arabic · العربية الفصحى→AM · Amharic · አማርኛ | 283 | Median 5.97 Mean 5.16 · 25th pct. 2.68 · 75th pct. 6.67 | Mean 0.819 25th pct. 0.809 · Median 0.834 · 75th pct. 0.840 | Mean 4.1 25th pct. 3.5 · Median 4.0 · 75th pct. 4.4 | Mean 5.6 25th pct. 5.0 · Median 5.6 · 75th pct. 5.9 | Mean 0.922 25th pct. 0.904 · Median 0.919 · 75th pct. 0.937 |
| Modern Standard Arabic → Egyptian ArabicAR · Modern Standard Arabic · العربية الفصحى→ARZ · Egyptian Arabic · مصري | 12 | Median 8.73 Mean 7.76 · 25th pct. 7.66 · 75th pct. 9.30 | Mean 0.769 25th pct. 0.761 · Median 0.781 · 75th pct. 0.797 | Mean 20.6 25th pct. 13.5 · Median 21.7 · 75th pct. 26.7 | Mean 29.0 25th pct. 24.0 · Median 31.3 · 75th pct. 33.4 | Mean 0.992 25th pct. 0.968 · Median 0.998 · 75th pct. 1.013 |
| Modern Standard Arabic → AzerbaijaniAR · Modern Standard Arabic · العربية الفصحى→AZ · Azerbaijani · Azərbaycan | 225 | Median 6.74 Mean 5.90 · 25th pct. 6.02 · 75th pct. 7.19 | Mean 0.798 25th pct. 0.787 · Median 0.810 · 75th pct. 0.827 | Mean 9.0 25th pct. 6.4 · Median 7.2 · 75th pct. 10.5 | Mean 14.2 25th pct. 12.3 · Median 13.5 · 75th pct. 16.3 | Mean 0.891 25th pct. 0.863 · Median 0.886 · 75th pct. 0.917 |
| Modern Standard Arabic → BengaliAR · Modern Standard Arabic · العربية الفصحى→BN · Bengali · বাংলা | 81 | Median 8.03 Mean 6.81 · 25th pct. 6.77 · 75th pct. 8.41 | Mean 0.815 25th pct. 0.804 · Median 0.819 · 75th pct. 0.825 | Mean 10.7 25th pct. 6.8 · Median 10.8 · 75th pct. 13.6 | Mean 12.3 25th pct. 9.4 · Median 12.9 · 75th pct. 15.1 | Mean 1.159 25th pct. 1.134 · Median 1.161 · 75th pct. 1.181 |
| Modern Standard Arabic → GermanAR · Modern Standard Arabic · العربية الفصحى→DE · German · Deutsch | 62 | Median 8.19 Mean 7.14 · 25th pct. 7.54 · 75th pct. 8.63 | Mean 0.778 25th pct. 0.769 · Median 0.786 · 75th pct. 0.796 | Mean 12.0 25th pct. 8.7 · Median 11.5 · 75th pct. 14.4 | Mean 15.2 25th pct. 12.3 · Median 15.0 · 75th pct. 16.9 | Mean 1.450 25th pct. 1.424 · Median 1.439 · 75th pct. 1.471 |
This release reports translation quality by language pair: medians and spread of automated scores (fluency, COMET, BLEU, sacreBLEU, length ratio) aggregated across evaluated directions. Run metadata describes recipes, metrics, and segment counts.