Abstractive Summarization on SAMSum (val)
53.8ROUGE-1GPT-3 (LoRA)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-3 (LoRA)Trainable Parameters=4.7M2021.06 | 53.8 | 29.8 | 45.9 | |
| GPT-3 (LoRA)Trainable Parameters=37.7M2021.06 | 53.4 | 29.2 | 45.1 | |
| GPT-3 (Adapter^L)Trainable Parameters=40.1M2021.06 | 53.2 | 29 | 45.1 | |
| GPT-3 (Adapter^H)Trainable Parameters=7.1M2021.06 | 53 | 28.9 | 44.8 | |
| GPT-3 (FT)Trainable Parameters=175,255.8M2021.06 | 52 | 28 | 44.5 | |
| GPT-3 (BitFit)Trainable Parameters=14.2M2021.06 | 51.3 | 27.4 | 43.5 | |
| GPT-3 (PreLayer)Trainable Parameters=20.2M2021.06 | 50.8 | 27.3 | 43.5 | |
| GPT-3 (PreEmbed)Trainable Parameters=3.2M2021.06 | 48.3 | 24.2 | 40.5 |