Scientific Extreme Summarization on SciTLDR (test)
47.7ROUGE-1EXT-ORACLE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EXT-ORACLEtype=upper bound2022.05 | 47.7 | 24.7 | 38.5 | |
| CITESEvaluation Protocol=Zero-shot, Adaptation Technique=prompting, Prompting conditions=gold 3 tokens2022.05 | 46.3 | 27.4 | 41.9 | |
| CITESEvaluation Protocol=Few-shot, Number of shots=1282022.05 | 44.5 | 21.6 | 36.5 | |
| CATTS_XSUMEvaluation Protocol=Fully-supervised, Pre-training=XSum2022.05 | 44.3 | 21.3 | 35.9 | |
| CATTSEvaluation Protocol=Fully-supervised2022.05 | 43.8 | 20.9 | 35.5 | |
| CITESEvaluation Protocol=Few-shot, Number of shots=322022.05 | 43.8 | 21.4 | 36.4 | |
| CITESEvaluation Protocol=Zero-shot, Adaptation Technique=prompting2022.05 | 43.5 | 20.9 | 36 | |
| CITESEvaluation Protocol=Zero-shot, Adaptation Technique=post-processing2022.05 | 43.4 | 19.7 | 34.8 | |
| BARTEvaluation Protocol=Fully-supervised, Base Model=BART-large2022.05 | 43.3 | 20.8 | 35 | |
| MatchSumEvaluation Protocol=Fully-supervised2022.05 | 42.7 | 20 | 34 | |
| BART_XSUMEvaluation Protocol=Fully-supervised, Pre-training=XSum2022.05 | 42.5 | 21.1 | 34.9 | |
| BARTEvaluation Protocol=Few-shot, Number of shots=1282022.05 | 42.1 | 19.1 | 33.4 | |
| BERTSumEvaluation Protocol=Fully-supervised2022.05 | 38.5 | 16.6 | 30.5 | |
| PACSUMEvaluation Protocol=Fully-supervised2022.05 | 19.3 | 4 | 15.1 |