Summarization on CNN/DM (MAT, Speedup)
6.51MAT ScoreGraft
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GraftModel=Vicuna-13B2026.05 | 6.51 | 3.63 | |
| EAGLE3-2KModel=Vicuna-13B2026.05 | 6.42 | 3.42 | |
| ECHOModel=Vicuna-13B2026.05 | 6.22 | 3.49 | |
| DDDModel=Vicuna-13B2026.05 | 6.07 | 3.48 | |
| GraftModel=LLaMA3.1-8B2026.05 | 5.65 | 3.31 | |
| EAGLE3-2KModel=LLaMA3.1-8B2026.05 | 5.47 | 3.05 | |
| ECHOModel=LLaMA3.1-8B2026.05 | 5.24 | 3.18 | |
| GraftModel=Qwen3-8B2026.05 | 3.41 | 2.37 | |
| EAGLE3Model=Qwen3-8B2026.05 | 3.25 | 1.95 | |
| ECHOModel=Qwen3-8B2026.05 | 3.18 | 2.23 | |
| TRModel=Vicuna-13B2026.05 | 2.88 | 2.24 | |
| GraftModel=Qwen3-32B2026.05 | 2.79 | 2.19 | |
| SAMDModel=Vicuna-13B2026.05 | 2.71 | 2.05 | |
| TRModel=Qwen3-8B2026.05 | 2.67 | 2.13 | |
| TRModel=LLaMA3.1-8B2026.05 | 2.65 | 2.14 | |
| EAGLE3Model=Qwen3-32B2026.05 | 2.55 | 1.82 | |
| TRModel=Qwen3-32B2026.05 | 2.53 | 1.97 | |
| ECHOModel=Qwen3-32B2026.05 | 2.51 | 1.98 | |
| PLDModel=Vicuna-13B2026.05 | 2.31 | 2.45 | |
| SpsModel=Vicuna-13B2026.05 | 2.26 | 1.69 | |
| TRModel=Qwen3-235B2026.05 | 2.23 | 1.77 | |
| GraftModel=Qwen3-235B2026.05 | 2.21 | 1.83 | |
| MedusaModel=Vicuna-13B2026.05 | 2.05 | 1.63 | |
| LogitSpecModel=Llama-3.1-8B-Instruct2025.07 | 2.04 | 1.85 | |
| EAGLE3-2KModel=Qwen3-235B2026.05 | 2.02 | 1.45 | |
| ECHOModel=Qwen3-235B2026.05 | 2.01 | 1.64 | |
| LogitSpecModel=Qwen-3-8B2025.07 | 1.77 | 1.59 | |
| LookaheadModel=Vicuna-13B2026.05 | 1.51 | 1.46 | |
| VanillaModel=Llama-3.1-8B-Instruct2025.07 | 1 | 1 | |
| VanillaModel=Qwen-3-8B2025.07 | 1 | 1 |