Machine Translation on gl-en (test)
29.94BLEUSalamandra 7B Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Salamandra 7B InstructBackbone=Salamandra 7B, Variant=Instruct2026.03 | 29.94 | |
| ALIA 40B InstructBackbone=ALIA 40B, Variant=Instruct2026.03 | 29.86 | |
| Qwen3 14B merge-GLBackbone=Qwen3 14B, Variant=merge-GL2026.03 | 29.21 | |
| Llama 3.1 8B merge-GLBackbone=Llama 3.1 8B, Variant=merge-GL2026.03 | 28.91 | |
| Qwen3 14B merge-multiBackbone=Qwen3 14B, Variant=merge-multi2026.03 | 27.63 | |
| Qwen3 8B merge-GLBackbone=Qwen3 8B, Variant=merge-GL2026.03 | 27.35 | |
| Llama 3.1 8B merge-multiBackbone=Llama 3.1 8B, Variant=merge-multi2026.03 | 27.19 | |
| Qwen3 14B merge-ESBackbone=Qwen3 14B, Variant=merge-ES2026.03 | 27.04 | |
| Llama 3.1 8B merge-ESBackbone=Llama 3.1 8B, Variant=merge-ES2026.03 | 26.91 | |
| Llama 3.1 8B InstructBackbone=Llama 3.1 8B, Variant=Instruct2026.03 | 26.55 | |
| Qwen3 14B merge-EUBackbone=Qwen3 14B, Variant=merge-EU2026.03 | 26.45 | |
| Llama 3.1 8B merge-EUBackbone=Llama 3.1 8B, Variant=merge-EU2026.03 | 26.14 | |
| Qwen3 8B merge-multiBackbone=Qwen3 8B, Variant=merge-multi2026.03 | 26.02 | |
| Qwen3 14B merge-CABackbone=Qwen3 14B, Variant=merge-CA2026.03 | 25.92 | |
| Qwen3 14B InstructBackbone=Qwen3 14B, Variant=Instruct2026.03 | 25.87 | |
| Llama 3.1 8B joint-EUBackbone=Llama 3.1 8B, Variant=joint-EU2026.03 | 25.71 | |
| Salamandra 2B InstructBackbone=Salamandra 2B, Variant=Instruct2026.03 | 25.27 | |
| Qwen3 8B merge-ESBackbone=Qwen3 8B, Variant=merge-ES2026.03 | 25 | |
| Qwen3 8B merge-EUBackbone=Qwen3 8B, Variant=merge-EU2026.03 | 24.6 | |
| Llama 3.1 8B merge-CABackbone=Llama 3.1 8B, Variant=merge-CA2026.03 | 24.49 | |
| Qwen3 8B InstructBackbone=Qwen3 8B, Variant=Instruct2026.03 | 24.39 | |
| Qwen3 8B merge-CABackbone=Qwen3 8B, Variant=merge-CA2026.03 | 24.01 | |
| PRENORM + FIXNORM + SCALENORM (4)Normalization Placement=PRENORM, Normalization Components=FIXNORM + SCALENORM2019.10 | 20.91 | |
| PRENORM + FIXNORM + LAYERNORM (3)Normalization Placement=PRENORM, Normalization Components=FIXNORM + LAYERNORM2019.10 | 19.38 | |
| PRENORM + LAYERNORM (2)Normalization Placement=PRENORM, Normalization Components=LAYERNORM2019.10 | 19.09 | |
| POSTNORM + LAYERNORM (1)Normalization Placement=POSTNORM, Normalization Components=LAYERNORM2019.10 | 18.47 | |
| POSTNORM + LAYERNORM (published)Normalization Placement=POSTNORM, Normalization Components=LAYERNORM, Status=Published2019.10 | 16.2 |