Abstractive Summarization on CNNDM full (test)
42ROUGE-1Z-Code++ Large
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Z-Code++ Largetraining_examples=1000, pretraining=Two-phase2022.08 | 42 | 19.6 | 28.9 | |
| PEGASUS-Largetraining_examples=10002022.08 | 41.7 | 19.4 | 38.3 | |
| Z-Code++ Largetraining_examples=100, pretraining=Two-phase2022.08 | 41.1 | 18.4 | 27.5 | |
| Z-Code++ Large (Phase 1)training_examples=1000, pretraining=Phase 1 only2022.08 | 40.7 | 18.3 | 28.3 | |
| PEGASUS-Largetraining_examples=1002022.08 | 40.3 | 18.2 | 37 | |
| Z-Code++ Largetraining_examples=0, zero-shot=true, pretraining=Two-phase2022.08 | 40 | 17.3 | 25.3 | |
| Z-Code++ Largetraining_examples=10, pretraining=Two-phase, best_checkpoint=unfine-tuned (0-shot)2022.08 | 40 | 17.3 | 25.3 | |
| PEGASUS-Largetraining_examples=102022.08 | 37.6 | 15.8 | 33.5 | |
| Z-Code++ Large (Phase 1)training_examples=100, pretraining=Phase 1 only2022.08 | 37.3 | 15 | 25.5 | |
| PEGASUS-Largetraining_examples=0, zero-shot=true2022.08 | 32.9 | 13.3 | 29.4 | |
| T5-Largetraining_examples=10002022.08 | 31.9 | 11.2 | 21.4 | |
| T5-Largetraining_examples=1002022.08 | 24.2 | 7.7 | 17.5 | |
| T5-Largetraining_examples=102022.08 | 19 | 5.1 | 13.6 | |
| T5-Largetraining_examples=0, zero-shot=true2022.08 | 18.5 | 4.9 | 13.3 | |
| Z-Code++ Large (Phase 1)training_examples=10, pretraining=Phase 1 only2022.08 | 11.9 | 1.5 | 8.7 | |
| Z-Code++ Large (Phase 1)training_examples=0, zero-shot=true, pretraining=Phase 1 only2022.08 | 3.5 | 0.1 | 3.1 |