Machine Translation on Aya Language Families 23
59.3COMET (AUS)M→D
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| M→DVariant=cloud2025.01 | 59.3 | 82.8 | 79.2 | 68.9 | 79.5 | 55.4 | 70.9 | |
| M→DVariant=shell2025.01 | 59 | 82.7 | 79.1 | 69 | 79.3 | 55.1 | 70.8 | |
| M↔DVariant=cloud-func2025.01 | 58.2 | 82.2 | 78 | 68.7 | 80.6 | 55.2 | 70.1 | |
| D→MVariant=cont2025.01 | 55.7 | 77.6 | 65.4 | 57 | 75.2 | 47.8 | 63.8 | |
| off-the-shelfParadigm=Baseline2025.01 | 55.2 | 81.7 | 74 | 60.7 | 76.5 | 47.6 | 66 | |
| D→MVariant=func2025.01 | 54.5 | 80.8 | 74.1 | 63.8 | 80.1 | — | 64.2 | |
| randaug-shellParadigm=Baseline2025.01 | 53.6 | 82 | 75.5 | 65 | 74.7 | 53.3 | 67.4 | |
| M↔DVariant=cloud-cont2025.01 | 53.5 | 80.7 | 79.9 | 62.3 | 82.3 | — | 64.9 | |
| fthrlParadigm=Baseline2025.01 | 53.2 | 81.9 | 74.9 | 65 | 74.8 | 53.8 | 67.3 | |
| M↔DVariant=cloud-all2025.01 | 52.9 | 79.3 | 79.6 | 63.5 | 81.9 | — | 65.2 | |
| D→MVariant=all2025.01 | 50.2 | 71.6 | 70.6 | 62.4 | 76.8 | — | 62.7 |