Summarization on CNNDM 10K (test)
35.8ROUGE-1Pre-trained_T5
Evaluation results
| Method | Links | |
|---|---|---|
| Pre-trained_T5Backbone=T5-Small (T5_1.1), Pre-training steps=524K, Pre-training dataset=C42022.06 | 35.8 | |
| Wiki 10KBackbone=T5-Small, Pre-training steps=10K, Pre-training dataset=Wikipedia2022.06 | 34 | |
| LIMEBackbone=T5-Small, Pre-training strategy=Synthetic2022.06 | 33.2 | |
| SetBackbone=T5-Small, Pre-training strategy=Synthetic (Simpler)2022.06 | 32.8 | |
| Nons_SummaryBackbone=T5-Small, Pre-training strategy=Synthetic, Optimizer=Adafactor2022.06 | 32 | |
| IdentityBackbone=T5-Small, Pre-training strategy=Synthetic (Simpler)2022.06 | 30.2 | |
| DyckBackbone=T5-Small, Pre-training strategy=Synthetic2022.06 | 27.1 | |
| Random_InitBackbone=T5-Small, Pre-training=None2022.06 | 18.9 |