Machine Translation on 120-document (test)
7.613Fluency Score S1Qwen3.5-plus
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3.5-plusFramework=MACAT2026.05 | 7.613 | 7.164 | 8.022 | 7.683 | 7.299 | 7.691 | 7.253 | 8.469 | 7.286 | |
| Deepseek-V3Framework=MACAT2026.05 | 7.483 | 7.094 | 8.254 | 7.752 | 7.443 | 8.437 | 7.132 | 8.276 | 6.73 | |
| Deepseek-V3Framework=Direct LLM2026.05 | 6.764 | 6.481 | 7.511 | 7.053 | 7.089 | 7.978 | 6.62 | 7.945 | 4.96 | |
| Qwen3.5-plusFramework=Direct LLM2026.05 | 6.65 | 5.887 | 7.795 | 6.993 | 6.405 | 7.409 | 6.223 | 7.648 | 4.535 | |
| CoD2026.05 | 6.081 | 5.972 | 7.415 | 6.715 | 6.359 | 8.22 | 5.853 | 6.797 | 4.384 | |
| Tower-plus2026.05 | 5.814 | 5.237 | 5.96 | 5.714 | 5.675 | 6.172 | 5.569 | 6.293 | 4.642 | |
| Qwen3-8BFramework=MACAT2026.05 | 5.58 | 5.105 | 7.581 | 6.438 | 5.959 | 7.284 | 5.619 | 6.885 | 4.692 | |
| Qwen3-8BFramework=Direct LLM2026.05 | 5.45 | 5.021 | 6.535 | 5.864 | 5.54 | 6.516 | 5.425 | 7.292 | 3.569 | |
| Google2026.05 | 5.136 | 4.738 | 6.567 | 5.732 | 5.218 | 7.22 | 5.063 | 6.077 | 3.79 |