Summarization on CNN/DM (Acc, Tp, Spd)
20.3Accuracy (Acc)Vanilla Decoding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Vanilla DecodingModel Series=Llama-3 (70B/1B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 20.3 | 15.3 | 1 | |
| SpecDecodeModel Series=Llama-3 (70B/1B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 20.3 | 22.8 | 1.49 | |
| Lossy SDModel Series=Llama-3 (70B/1B), Shot=0-shot, Protocol=ROUGE-L, τ=0.62026.04 | 20.3 | 23.6 | 1.55 | |
| LookaheadModel Series=Llama-3 (70B/1B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 20.3 | 12.5 | 0.82 | |
| CSDModel Series=Llama-3 (70B/1B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 20.3 | 24.4 | 1.59 | |
| SWIFTModel Series=Llama-3 (70B/1B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 20.2 | 17.5 | 1.14 | |
| Vanilla DecodingModel Series=Qwen-2.5 (72B/7B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 19.9 | 15.2 | 1 | |
| SpecDecodeModel Series=Qwen-2.5 (72B/7B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 19.9 | 20.2 | 1.33 | |
| CSDModel Series=Qwen-2.5 (72B/7B), Shot=0-shot, Protocol=ROUGE-L2026.04 | 19.9 | 23.7 | 1.57 |