Cross-lingual Summarization on CrossSum (test-dev)
29.4EN ScoreSBARThez-BGE
Evaluation results
| Method | Links | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SBARThez-BGE2026.03 | 29.4 | 29.83 | 29.15 | 29.91 | 28.59 | 33.25 | 28.92 | 30.64 | 30.95 | 25.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MT+BARThez2026.03 | 29.11 | 30.71 | 30.05 | 28.89 | 28.68 | 15.65 | 30.18 | 31.62 | 31.33 | 26.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LLaMA-8B2026.03 | 25 | 26.33 | 24.61 | 25.61 | 24.19 | 29.23 | 26.12 | 25.61 | 21.48 | 20.68 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LLaMA-8B2026.03 | — | — | — | — | — | — | — | — | — | — | 14.62 | 21.61 | 25.99 | 19.89 | 23.96 | 21.64 | 24.22 | 15.32 | 21.65 | 24.03 | 19.38 | 17.92 | 22.57 | 25.53 | |
| MT+BARThez2026.03 | — | — | — | — | — | — | — | — | — | — | 16.05 | 17.67 | 27.42 | 24.37 | 16.25 | 5.28 | 22.54 | 15.24 | 6.44 | 27.09 | 3.09 | 5.45 | — | — | |
| SBARThez-BGE2026.03 | — | — | — | — | — | — | — | — | — | — | 18.4 | 17.19 | 28.38 | 25.81 | 30.75 | 28.52 | 29.44 | 25.72 | 26.03 | 25.98 | 25.11 | 26.77 | 26.14 | 29.81 |