Machine Translation on MIXED #3000 English to Luxembourgish (test)
0.26CometScoreGPT-5
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5Setting=Base Settings2025.10 | 0.26 | 39.3 | 56.2 | |
| Qwen/Qwen3-30B-A3B-Instruct-2507Parameters=30B, Type=Instruct, Setting=Base Settings2025.10 | 0.26 | 14.4 | 35.84 | |
| Qwen/Qwen3-Next-80B-A3B-InstructParameters=80B, Type=Instruct, Setting=Base Settings2025.10 | 0.26 | 19.15 | 40.31 | |
| Qwen/Qwen3-Next-80B-A3B-ThinkingParameters=80B, Type=Thinking, Setting=Base Settings2025.10 | 0.24 | 18.53 | 40.41 | |
| google/gemma-3-12b-itParameters=12B, Type=Instruct, Setting=Base Settings2025.10 | 0.22 | 23.06 | 44.17 | |
| google/gemma-3-27b-itParameters=27B, Type=Instruct, Setting=Base Settings2025.10 | 0.22 | 17.9 | 39.75 | |
| meta-llama/Llama-3.3-70B-InstructParameters=70B, Type=Instruct, Setting=Base Settings2025.10 | 0.22 | 26.52 | 46.87 | |
| google/gemma-2-9b-itParameters=9B, Type=Instruct, Setting=Base Settings2025.10 | 0.18 | 11.28 | 31.87 | |
| Qwen/Qwen3-4B-Instruct-2507Parameters=4B, Type=Instruct, Setting=Base Settings2025.10 | 0.15 | 8.12 | 26.74 | |
| google/gemma-3-4b-itParameters=4B, Type=Instruct, Setting=Base Settings2025.10 | 0.14 | 10.09 | 31.07 | |
| meta-llama/Llama-3.2-1B-InstructParameters=1B, Type=Instruct, Setting=Base Settings2025.10 | 0.08 | 1.72 | 13.16 | |
| meta-llama/Llama-3.2-3B-InstructParameters=3B, Type=Instruct, Setting=Base Settings2025.10 | 0.06 | 3.79 | 21.3 | |
| google/gemma-2-2b-itParameters=2B, Type=Instruct, Setting=Base Settings2025.10 | 0.04 | 3.07 | 17.8 |