Abstractive Summarization on XSum (val)
0.1624ROUGE-2G-XKD
Evaluation results
| Method | Links | |
|---|---|---|
| G-XKDInitialization Setting=large→base2026.02 | 0.1624 | |
| GKDInitialization Setting=large→base2026.02 | 0.1618 | |
| MiniLLMInitialization Setting=large→base2026.02 | 0.1615 | |
| S-XKDInitialization Setting=large→base2026.02 | 0.1612 | |
| SKDInitialization Setting=large→base2026.02 | 0.161 | |
| SeqXKDInitialization Setting=large→base2026.02 | 0.1609 | |
| SeqKDInitialization Setting=large→base2026.02 | 0.1607 | |
| SFTInitialization Setting=large→base2026.02 | 0.159 | |
| G-XKDInitialization Setting=large→small2026.02 | 0.1381 | |
| MiniLLMInitialization Setting=large→small2026.02 | 0.1369 | |
| GKDInitialization Setting=large→small2026.02 | 0.1362 | |
| S-XKDInitialization Setting=large→small2026.02 | 0.1345 | |
| SKDInitialization Setting=large→small2026.02 | 0.1338 | |
| SeqXKDInitialization Setting=large→small2026.02 | 0.1336 | |
| SeqKDInitialization Setting=large→small2026.02 | 0.133 | |
| SFTInitialization Setting=large→small2026.02 | 0.1278 |