Text Summarization on DialogueSUM (test)
57ROUGE-LTeacher
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TeacherTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 57 | — | — | — | |
| InstructDS2023.10 | 45.3 | 47.7 | 21.8 | — | |
| BART2023.10 | 44.8 | 47.2 | 21.1 | — | |
| OmniVec22025.07 | 41.4 | 47.6 | 22.1 | 72.8 | |
| SICK++Commonsense knowledge source=COMET2022.09 | 41.05 | 46.26 | 20.95 | 71.3 | |
| SICK2025.07 | 40.83 | 46.2 | 20.39 | 71.32 | |
| SICK++Commonsense knowledge source=PARA-COMET2022.09 | 40.83 | 46.2 | 20.39 | 71.32 | |
| SICKCommonsense knowledge source=PARA-COMET2022.09 | 40.75 | 46.01 | 20.3 | 71.57 | |
| SICKCommonsense knowledge source=COMET2022.09 | 40.26 | 45.7 | 20.08 | 71.08 | |
| OmniVec2025.07 | 40.19 | 46.91 | 21.22 | 71.91 | |
| Flan-UL22023.10 | 39.6 | 40.7 | 16.5 | — | |
| Flan-T5-XXLsize=XXL2023.10 | 38.7 | 39.3 | 15.8 | — | |
| TeacherTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 37.5 | — | — | — | |
| TeacherTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 37.4 | — | — | — | |
| Flan-T5-Largesize=Large2023.10 | 37.2 | 38.7 | 14.3 | — | |
| CODS2025.07 | 36.98 | 44.27 | 17.9 | 70.49 | |
| CODSRe-implementation status=re-implemented2022.09 | 36.98 | 44.27 | 17.9 | 70.49 | |
| BART-xsumRe-implementation status=re-implemented2022.09 | 36.57 | 45.15 | 19.78 | 71.09 | |
| ChatGPT2023.10 | 36.3 | 38.4 | 12.8 | — | |
| AdaSwitchTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 35.6 | — | — | — | |
| AdaSwitchTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 35.6 | — | — | — | |
| ImitKDTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 35.1 | — | — | — | |
| Off-policyTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 35.1 | — | — | — | |
| SWITCHTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 35.1 | — | — | — | |
| SKDTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 35 | — | — | — | |
| SKDTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 34.9 | — | — | — | |
| ImitKDTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 34.9 | — | — | — | |
| Off-policyTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 34.6 | — | — | — | |
| UniLMRe-implementation status=re-implemented2022.09 | 34.36 | 42.38 | 16.88 | 69.4 | |
| On-policyTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 34.3 | — | — | — | |
| On-policyTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 34.1 | — | — | — | |
| SWITCHTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 33.7 | — | — | — | |
| PEGASUSRe-implementation status=re-implemented2022.09 | 33.41 | 38.4 | 13.84 | 68.2 | |
| AdaSwitchTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 32.6 | — | — | — | |
| ImitKDTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 32.5 | — | — | — | |
| Off-policyTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 32.4 | — | — | — | |
| SFTTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 32.3 | — | — | — | |
| On-policyTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 32.3 | — | — | — | |
| SKDTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 32.3 | — | — | — | |
| SeqKDTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 32.1 | — | — | — | |
| SWITCHTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 31.8 | — | — | — | |
| SFTTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 31.8 | — | — | — | |
| SeqKDTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 31 | — | — | — | |
| SFTTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 30.3 | — | — | — | |
| SeqKDTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 30.1 | — | — | — | |
| Alpaca2023.10 | 24.6 | 25.6 | 4.9 | — | |
| StudentTeacher and Student Model Pair=Llama-3.1-3b to Llama-3.1-1b2025.10 | 13.5 | — | — | — | |
| StudentTeacher and Student Model Pair=Qwen-2.5-3b to Qwen-2.5-0.5b2025.10 | 12.1 | — | — | — | |
| StudentTeacher and Student Model Pair=Gemma-7b to Gemma-2b2025.10 | 11.6 | — | — | — |