Summarization on XL-SUM Target language (SUM metric)
23.2SUM ScoreSSU-Wanda
Evaluation Results
| Method | Links | |
|---|---|---|
| SSU-WandaModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 23.2 | |
| SSU-RandModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 23 | |
| GMTModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 22.9 | |
| FFTModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 22.9 | |
| SSU-WandaModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 22.8 | |
| HFTModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 22.8 | |
| GMTModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 22.8 | |
| FFTModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 22.7 | |
| SSU-RandModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 22.7 | |
| SSU-MagModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 22.7 | |
| HFTModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 22.6 | |
| SSU-MagModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 22.6 | |
| AdaLoRAModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 22.3 | |
| AdaLoRAModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 21.9 | |
| SourceModel Scale=13B, Evaluation Protocol=Zero-shot2025.12 | 20.7 | |
| SourceModel Scale=7B, Evaluation Protocol=Zero-shot2025.12 | 20.2 |