Machine Translation on BOUQuET (dev)
86.9Translation Rating (fra)NLLB-3.3B
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NLLB-3.3BMode=raw scores2026.06 | 86.9 | 82.4 | 83.1 | 71.9 | 78.2 | 80.5 | 79 | 71 | 77 | 65.6 | 71.9 | 72.9 | |
| Gemma-3-27BInstructions=with2026.06 | 10.3 | 15.8 | 12.7 | 5.6 | 3.4 | 9.6 | 19.2 | 27.6 | 20 | 13.8 | 13.2 | 18.7 | |
| Gemma-3-12BInstructions=with2026.06 | 8.7 | 14.6 | 11.1 | 8.3 | 14.3 | 2.4 | 18 | 26.6 | 19 | 1.9 | 3.1 | 12.5 | |
| Gemma-3-27BInstructions=without2026.06 | 8 | 10.9 | 11.3 | 5 | 2.9 | 7.6 | 10.1 | 12.4 | 13.8 | 6.7 | 5.4 | 9.7 | |
| Gemma-3-12BInstructions=without2026.06 | 6.6 | 8.5 | 8.9 | 7.1 | 17 | 0 | 7.9 | 8.8 | 9.7 | 4.8 | 14.9 | 1.3 | |
| Gemma-3-4BInstructions=with2026.06 | 1.1 | 6.9 | 11.6 | 24.9 | 52.9 | 16.3 | 9.1 | 19.1 | 2.3 | 18.3 | 42.9 | 7.1 | |
| Gemma-3-4BInstructions=without2026.06 | 0.6 | 4.5 | 1.8 | 26.1 | 34.9 | 11.6 | 2.9 | 7.7 | 0.5 | 23.6 | 32.5 | 9 |