Machine Translation on FLORES X→Eng (devtest)
0.889COMET Score (Low)charSONAR-75
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| charSONAR-75Training languages=63 known + 12 new, Number of parameters=1.3B2025.05 | 0.889 | 0.914 | 0.949 | 0.917 | 0.863 | |
| charSONAR-63Training languages=63 known, Number of parameters=1.3B, Zero-shot evaluation (New languages)=true2025.05 | 0.889 | 0.914 | 0.949 | 0.917 | 0.53 | |
| SONAR-75Training languages=63 known + 12 new, Number of parameters=1.3B2025.05 | 0.882 | 0.909 | 0.948 | 0.913 | 0.859 | |
| SONAR-63Training languages=63 known, Number of parameters=1.3B, Zero-shot evaluation (New languages)=true2025.05 | 0.882 | 0.909 | 0.947 | 0.913 | 0.517 | |
| NLLB-200Training languages=200, Number of parameters=1.3B2025.05 | 0.877 | 0.914 | 0.949 | 0.913 | 0.454 | |
| SONAR-200Training languages=200, Number of parameters=1.3B, Zero-shot evaluation (New languages)=true2025.05 | 0.851 | 0.894 | 0.944 | 0.897 | 0.45 |