Label Projection on MLQA (Multi-lingual Metrics)
84.8Average COMET ScoreAwesome-align
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Awesome-alignLanguage=Arabic2026.03 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | 51.9 | |
| LabelPigeonLanguage=Arabic2026.03 | 84.8 | — | — | — | — | — | — | — | — | — | — | — | — | 78 | |
| LabelPigeonLanguage=Vietnamese2026.03 | 84.7 | — | — | — | — | — | — | — | — | — | — | — | — | 82.3 | |
| LabelPigeon2026.03 | 84.3 | 84 | 81.4 | 82.8 | 73.8 | 83.7 | 85.7 | 86.4 | 86.8 | 84.9 | 88.3 | 84.2 | 85 | 83.5 | |
| LabelPigeonLanguage=German2026.03 | 84 | — | — | — | — | — | — | — | — | — | — | — | — | 83.4 | |
| LabelPigeonLanguage=Spanish2026.03 | 84 | — | — | — | — | — | — | — | — | — | — | — | — | 88.8 | |
| EasyProjectLanguage=Arabic2026.03 | 83.7 | — | — | — | — | — | — | — | — | — | — | — | — | 80.7 | |
| Awesome-alignLanguage=Vietnamese2026.03 | 83 | — | — | — | — | — | — | — | — | — | — | — | — | 49.1 | |
| EasyProjectLanguage=Vietnamese2026.03 | 82.7 | — | — | — | — | — | — | — | — | — | — | — | — | 78.5 | |
| Awesome-alignLanguage=Spanish2026.03 | 82.5 | — | — | — | — | — | — | — | — | — | — | — | — | 58.6 | |
| Awesome-alignLanguage=German2026.03 | 82.4 | — | — | — | — | — | — | — | — | — | — | — | — | 60.3 | |
| EasyProjectLanguage=Spanish2026.03 | 82.3 | — | — | — | — | — | — | — | — | — | — | — | — | 78.9 | |
| LabelPigeonLanguage=Average2026.03 | 82.3 | — | — | — | — | — | — | — | — | — | — | — | — | 79.9 | |
| Awesome-align2026.03 | 82.2 | 81.9 | 39.6 | 80.3 | 37.6 | 81.4 | 55.2 | 85.1 | 54.5 | 83.3 | 51.9 | 80.9 | 46.2 | 47.5 | |
| EasyProject2026.03 | 81.7 | 81 | 63.6 | 79.7 | 62.1 | 80.9 | 74.3 | 84.3 | 76.9 | 82.8 | 79.9 | 81.3 | 74.9 | 71.9 | |
| Awesome-alignLanguage=Average2026.03 | 81.6 | — | — | — | — | — | — | — | — | — | — | — | — | 52.8 | |
| EasyProjectLanguage=German2026.03 | 81.4 | — | — | — | — | — | — | — | — | — | — | — | — | 77.2 | |
| EasyProjectLanguage=Average2026.03 | 80.8 | — | — | — | — | — | — | — | — | — | — | — | — | 76.5 | |
| Awesome-alignLanguage=Chinese2026.03 | 80.4 | — | — | — | — | — | — | — | — | — | — | — | — | 40.6 | |
| LabelPigeonLanguage=Chinese2026.03 | 79.6 | — | — | — | — | — | — | — | — | — | — | — | — | 67.8 | |
| Gemma 3 27BBackbone=Gemma 3, Number of parameters=27B2026.03 | 79.3 | 78.7 | 57.3 | 78.3 | 48.7 | 77.6 | 66.2 | 80.3 | 58.2 | 79.7 | 59.4 | 81 | 63.7 | 58.9 | |
| EasyProjectLanguage=Chinese2026.03 | 79.1 | — | — | — | — | — | — | — | — | — | — | — | — | 63.9 | |
| LabelPigeonLanguage=Hindi2026.03 | 76.9 | — | — | — | — | — | — | — | — | — | — | — | — | 79.3 | |
| Awesome-alignLanguage=Hindi2026.03 | 76.7 | — | — | — | — | — | — | — | — | — | — | — | — | 56.1 | |
| EasyProjectLanguage=Hindi2026.03 | 75.7 | — | — | — | — | — | — | — | — | — | — | — | — | 80.1 | |
| Gemma 3 27BLanguage=Vietnamese2026.03 | 62.2 | — | — | — | — | — | — | — | — | — | — | — | — | 73 | |
| Gemma 3 27BLanguage=German2026.03 | 59.9 | — | — | — | — | — | — | — | — | — | — | — | — | 77.9 | |
| Gemma 3 27BLanguage=Spanish2026.03 | 59.1 | — | — | — | — | — | — | — | — | — | — | — | — | 76.3 | |
| Gemma 3 27BLanguage=Average2026.03 | 54.6 | — | — | — | — | — | — | — | — | — | — | — | — | 68.1 | |
| Gemma 3 27BLanguage=Chinese2026.03 | 53.7 | — | — | — | — | — | — | — | — | — | — | — | — | 52.9 | |
| Gemma 3 27BLanguage=Arabic2026.03 | 47.2 | — | — | — | — | — | — | — | — | — | — | — | — | 65 | |
| Gemma 3 27BLanguage=Hindi2026.03 | 45.3 | — | — | — | — | — | — | — | — | — | — | — | — | 63.4 |