Cross-lingual Summarization on MEA Low-resource languages 1.0 (test)
4CoherenceT-S
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| T-SModel=Qwen3.5-9B, Method=translate-then-summarize2026.05 | 4 | 4.01 | 4.54 | 4.11 | |
| S-TModel=Qwen3.5-9B, Method=summarize-then-translate2026.05 | 3.94 | 4.02 | 4.44 | 4.1 | |
| E2EModel=Qwen3.5-9B, Method=end-to-end2026.05 | 3.93 | 4.08 | 4.41 | 4.15 | |
| S-TModel=gpt-oss-20b, Method=summarize-then-translate2026.05 | 3.41 | 3.5 | 3.46 | 3.51 | |
| T-SModel=gpt-oss-20b, Method=translate-then-summarize2026.05 | 3.32 | 3.24 | 4.03 | 3.48 | |
| E2EModel=gpt-oss-20b, Method=end-to-end2026.05 | 3.15 | 3.28 | 3.27 | 3.23 | |
| S-TModel=Tiny-Aya-Global, Method=summarize-then-translate2026.05 | 3.01 | 3.2 | 3.59 | 3.1 | |
| E2EModel=Tiny-Aya-Global, Method=end-to-end2026.05 | 3 | 3.25 | 3.61 | 3.09 | |
| T-SModel=Tiny-Aya-Global, Method=translate-then-summarize2026.05 | 1.57 | 2.02 | 2.69 | 1.62 | |
| T-SModel=Qwen3.5-2B, Method=translate-then-summarize2026.05 | 1.46 | 1.67 | 1.88 | 1.67 | |
| S-TModel=Qwen3.5-2B, Method=summarize-then-translate2026.05 | 1.31 | 1.55 | 1.61 | 1.56 | |
| E2EModel=Qwen3.5-2B, Method=end-to-end2026.05 | 1.08 | 1.26 | 1.43 | 1.19 |