Cross-lingual Summarization on MEA Mid-resource languages 1.0 (test)
4.09CoherenceE2E
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| E2EModel=Qwen3.5-9B, Method=end-to-end2026.05 | 4.09 | 4.32 | 4.75 | 4.45 | |
| S-TModel=Qwen3.5-9B, Method=summarize-then-translate2026.05 | 4.07 | 4.23 | 4.72 | 4.4 | |
| T-SModel=Qwen3.5-9B, Method=translate-then-summarize2026.05 | 4.07 | 4.23 | 4.74 | 4.38 | |
| E2EModel=Tiny-Aya-Global, Method=end-to-end2026.05 | 4.02 | 4.12 | 4.49 | 4.2 | |
| E2EModel=gpt-oss-20b, Method=end-to-end2026.05 | 4 | 4.06 | 4.56 | 4.18 | |
| S-TModel=Tiny-Aya-Global, Method=summarize-then-translate2026.05 | 3.98 | 3.95 | 4.35 | 4.12 | |
| S-TModel=gpt-oss-20b, Method=summarize-then-translate2026.05 | 3.96 | 4.06 | 4.5 | 4.17 | |
| T-SModel=Tiny-Aya-Global, Method=translate-then-summarize2026.05 | 3.92 | 4.03 | 4.37 | 4.09 | |
| T-SModel=gpt-oss-20b, Method=translate-then-summarize2026.05 | 3.67 | 3.71 | 4.52 | 3.68 | |
| S-TModel=Qwen3.5-2B, Method=summarize-then-translate2026.05 | 3.49 | 3.28 | 3.37 | 3.59 | |
| T-SModel=Qwen3.5-2B, Method=translate-then-summarize2026.05 | 3.25 | 3.29 | 3.65 | 3.47 | |
| E2EModel=Qwen3.5-2B, Method=end-to-end2026.05 | 3.07 | 3.09 | 3.13 | 3.23 |