Cross-lingual Summarization on MEA High-resource languages 1.0 (test)
4.25CoherenceE2E
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| E2EModel=Qwen3.5-9B, Method=end-to-end2026.05 | 4.25 | 4.57 | 4.87 | 4.65 | |
| S-TModel=Qwen3.5-9B, Method=summarize-then-translate2026.05 | 4.23 | 4.5 | 4.87 | 4.62 | |
| T-SModel=Qwen3.5-9B, Method=translate-then-summarize2026.05 | 4.22 | 4.51 | 4.86 | 4.6 | |
| E2EModel=gpt-oss-20b, Method=end-to-end2026.05 | 4.14 | 4.33 | 4.82 | 4.43 | |
| E2EModel=Tiny-Aya-Global, Method=end-to-end2026.05 | 4.12 | 4.25 | 4.75 | 4.37 | |
| S-TModel=gpt-oss-20b, Method=summarize-then-translate2026.05 | 4.12 | 4.32 | 4.8 | 4.43 | |
| S-TModel=Tiny-Aya-Global, Method=summarize-then-translate2026.05 | 4.05 | 4.09 | 4.74 | 4.29 | |
| T-SModel=Tiny-Aya-Global, Method=translate-then-summarize2026.05 | 4.04 | 4.14 | 4.68 | 4.25 | |
| S-TModel=Qwen3.5-2B, Method=summarize-then-translate2026.05 | 3.84 | 3.71 | 4.27 | 3.96 | |
| T-SModel=Qwen3.5-2B, Method=translate-then-summarize2026.05 | 3.76 | 3.79 | 4.23 | 3.98 | |
| T-SModel=gpt-oss-20b, Method=translate-then-summarize2026.05 | 3.72 | 3.89 | 4.8 | 3.88 | |
| E2EModel=Qwen3.5-2B, Method=end-to-end2026.05 | 3.7 | 3.65 | 4.14 | 3.87 |