Abstractive Summarization on XLSum
49.1ROUGE-LmT5-small (Student)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| mT5-small (Student)Language=Pashto, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 49.1 | 52.5 | 32.7 | 122.4 | |
| mT5-XLSum (Teacher)Language=Hausa, Parameters=966M, Role=Teacher2026.04 | 40.8 | 46.2 | 26.9 | — | |
| mT5-XLSum (Teacher)Language=Pashto, Parameters=966M, Role=Teacher2026.04 | 40.1 | 45 | 22.9 | — | |
| mT5-small (Student)Language=Hausa, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 37.9 | 42.6 | 25.8 | 92.9 | |
| mT5-XLSum (Teacher)Language=Hindi, Parameters=966M, Role=Teacher2026.04 | 37.2 | 41.9 | 21.8 | — | |
| mT5-XLSum (Teacher)Language=Urdu, Parameters=966M, Role=Teacher2026.04 | 37.2 | 41.8 | 21.3 | — | |
| mT5-XLSum (Teacher)Language=Nepali, Parameters=966M, Role=Teacher2026.04 | 34.3 | 36.7 | 19.3 | — | |
| mT5-XLSum (Teacher)Language=Swahili, Parameters=966M, Role=Teacher2026.04 | 34.3 | 39.2 | 21.1 | — | |
| mT5-XLSum (Teacher)Language=Average, Parameters=966M, Role=Teacher2026.04 | 34.2 | 38 | 19.7 | — | |
| mT5-small (Student)Language=Urdu, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 33 | 37 | 19.5 | 88.8 | |
| mT5-XLSum (Teacher)Language=Indonesian, Parameters=966M, Role=Teacher2026.04 | 32.8 | 36.7 | 18 | — | |
| mT5-XLSum (Teacher)Language=Persian, Parameters=966M, Role=Teacher2026.04 | 32.4 | 35.2 | 16.7 | — | |
| mT5-small (Student)Language=Hindi, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 30.8 | 34.4 | 16.5 | 83 | |
| mT5-small (Student)Language=Nepali, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 30.3 | 30.8 | 16.3 | 88.4 | |
| mT5-small (Student)Language=Average, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 29.9 | 32.7 | 17.5 | 86.5 | |
| mT5-XLSum (Teacher)Language=Turkish, Parameters=966M, Role=Teacher2026.04 | 27 | 29.1 | 14.5 | — | |
| mT5-XLSum (Teacher)Language=Amharic, Parameters=966M, Role=Teacher2026.04 | 26.2 | 28.6 | 14.8 | — | |
| mT5-small (Student)Language=Persian, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 25.4 | 29.2 | 13 | 78.2 | |
| mT5-small (Student)Language=Swahili, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 25.3 | 28.9 | 13.9 | 73.8 | |
| mT5-small (Student)Language=Amharic, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 24.5 | 25.3 | 14 | 93.5 | |
| mT5-small (Student)Language=Indonesian, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 23.8 | 26.3 | 12.6 | 72.5 | |
| mT5-small (Student)Language=Turkish, Parameters=300M, Role=Student, Compression=3.2x, Distillation=pseudo-label KD2026.04 | 19.2 | 20 | 10.4 | 71.1 | |
| CC-TUNING+MTModel Backbone=LLaMA-3.1-8B2025.06 | 13.05 | — | — | — | |
| ML-SFT+MTModel Backbone=LLaMA-3.1-8B2025.06 | 12.89 | — | — | — | |
| CC-TUNING+MTModel Backbone=Qwen2.5-7B2025.06 | 12.87 | — | — | — | |
| CC-TUNING+ENModel Backbone=LLaMA-3.1-8B2025.06 | 12.78 | — | — | — | |
| CC-TUNING+ENModel Backbone=Qwen2.5-7B2025.06 | 12.63 | — | — | — | |
| CC-TUNINGModel Backbone=Qwen2.5-7B2025.06 | 12.5 | — | — | — | |
| ML-SFT+MTModel Backbone=Qwen2.5-7B2025.06 | 12.48 | — | — | — | |
| ML-SFTModel Backbone=Qwen2.5-7B2025.06 | 12.4 | — | — | — | |
| CC-TUNINGModel Backbone=LLaMA-3.1-8B2025.06 | 12.38 | — | — | — | |
| ML-SFTModel Backbone=LLaMA-3.1-8B2025.06 | 12.27 | — | — | — | |
| ML-SFT+ENModel Backbone=Qwen2.5-7B2025.06 | 12.2 | — | — | — | |
| ML-SFT+ENModel Backbone=LLaMA-3.1-8B2025.06 | 12.04 | — | — | — |