Multi-document Summarization on ICLR metareview motivations (test)
39ROUGE-1Llama 7b Instruct
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Llama 7b InstructSummarization Type=Abstractive2024.06 | 39 | 9 | 18 | 23 | 63 | 49 | 25 | 79 | |
| LSASummarization Type=Extractive2024.06 | 38 | 8 | 16 | 14 | 57 | 59 | 19 | 94 | |
| LexRankSummarization Type=Extractive2024.06 | 38 | 9 | 17 | 18 | 56 | 60 | 21 | 95 | |
| CoopSummarization Type=Abstractive2024.06 | 36 | 8 | 19 | 8 | 26 | 51 | 9 | 26 | |
| GLIMPSE-UniqueSummarization Type=Abstractive2024.06 | 34 | 7 | 16 | 33 | 44 | 54 | 27 | 84 | |
| GLIMPSE-SpeakerSummarization Type=Abstractive2024.06 | 33 | 7 | 15 | 32 | 44 | 53 | 27 | 90 | |
| RandomSummarization Type=Extractive2024.06 | 32 | 6 | 15 | 9 | 48 | 58 | 15 | 94 | |
| GLIMPSE-UniqueSummarization Type=Extractive2024.06 | 27 | 6 | 13 | 13 | 39 | 38 | 15 | 89 | |
| PlanSumSummarization Type=Abstractive2024.06 | 25 | 6 | 14 | 7 | 21 | 32 | 13 | 37 | |
| GLIMPSE-SpeakerSummarization Type=Extractive2024.06 | 22 | 4 | 11 | 9 | 36 | 36 | 13 | 89 | |
| QTSummarization Type=Extractive2024.06 | 21 | 4 | 12 | 9 | 35 | 13 | 12 | 80 |