Summarization on CNNDM (test) with Efficiency Metrics
13.05ROUGE-2VIA-SD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VIA-SDModel=T5 S→XL, Temperature=12026.06 | 13.05 | 24 | 2.4 | |
| Faster CascadesModel=T5 S→XL, Temperature=12026.06 | 12.95 | 34 | 1.95 | |
| Speculative DecodingModel=T5 S→XL, Temperature=12026.06 | 12.9 | 38 | 1.7 | |
| Cascade SDModel=T5 S→XL, Temperature=12026.06 | 12.9 | 35 | 1.85 | |
| VIA-SDModel=T5 S→L, Temperature=12026.06 | 12.81 | 26 | 2.1 | |
| Faster CascadesModel=T5 S→L, Temperature=12026.06 | 12.63 | 34 | 1.88 | |
| Speculative DecodingModel=T5 S→L, Temperature=12026.06 | 11.2 | 36 | 1.79 | |
| Cascade SDModel=T5 S→L, Temperature=12026.06 | 11.2 | 33 | 1.9 |