Machine Translation on FLORES-200 (Source language en)
48.2MT ScoreSSU-Wanda
Evaluation results
| Method | Links | |
|---|---|---|
| SSU-WandaModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 48.2 | |
| SSU-WandaModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 45.7 | |
| GMTModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 45.5 | |
| SSU-RandModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 45.5 | |
| HFTModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 45.2 | |
| SSU-MagModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 44.7 | |
| HFTModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 44.1 | |
| SSU-RandModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 43.9 | |
| FFTModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 42.8 | |
| SSU-MagModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 40.2 | |
| FFTModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 40.1 | |
| GMTModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 37.5 | |
| AdaLoRAModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 36.6 | |
| AdaLoRAModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 34.1 | |
| SourceModel Scale=13B, Evaluation Protocol=3-shot2025.12 | 33.3 | |
| SourceModel Scale=7B, Evaluation Protocol=3-shot2025.12 | 30 |