Extreme Summarization on XSUM (5000 random instances)
1.73Speedup FactorGSD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GSDModel=LLaMA-2-70b2024.07 | 1.73 | 83.1 | 1,544.8 | 3,280 | |
| SSDModel=LLaMA-2-70b2024.07 | 1.56 | 65.2 | 773.2 | — | |
| TSDModel=LLaMA-2-70b2024.07 | 1.42 | 78.4 | 22,512.4 | 0 | |
| GSDModel=LLaMA-2-70b-chat2024.07 | 1.32 | 64.2 | 1,545.7 | 3,040 | |
| TSDModel=LLaMA-2-70b-chat2024.07 | 1.3 | 63.4 | 4,601.2 | 0 | |
| Self SSDModel=LLaMA-2-70b2024.07 | 1.28 | — | — | — | |
| SSDModel=LLaMA-2-70b-chat2024.07 | 1.19 | 49.6 | 989.4 | — |