Summarization on CNN/DM (M and Speedup)
10.64M ScoreDOUBLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DOUBLEBase Model=Deepseek-33B2026.01 | 10.64 | 4.05 | |
| DOUBLEBase Model=Qwen3-14B2026.01 | 9.64 | 1.89 | |
| DOUBLEBase Model=LLaMA3.3-70B2026.01 | 8.64 | 3.75 | |
| DOUBLEBase Model=LLaMA2-70B2026.01 | 7.84 | 3.05 | |
| PEARLBase Model=Deepseek-33B2026.01 | 7.76 | 2.77 | |
| DOUBLEBase Model=LLaMA3.3-70B, Temperature=1, Decoding Setting=non-greedy2026.01 | 7.62 | 3.31 | |
| PEARLBase Model=LLaMA3.3-70B2026.01 | 7.12 | 3.23 | |
| PEARLBase Model=LLaMA2-70B2026.01 | 6.76 | 2.37 | |
| PEARLBase Model=LLaMA3.3-70B, Temperature=1, Decoding Setting=non-greedy2026.01 | 6.69 | 3.04 | |
| DOUBLEBase Model=Qwen3-32B2026.01 | 6.64 | 2.56 | |
| OuroborosBase Model=Deepseek-33B2026.01 | 5.97 | 2.92 | |
| DOUBLEBase Model=Qwen3-32B, Temperature=1, Decoding Setting=non-greedy2026.01 | 5.86 | 2.26 | |
| PEARLBase Model=Qwen3-14B2026.01 | 5.62 | 1.28 | |
| OuroborosBase Model=LLaMA2-70B2026.01 | 5.21 | 2.25 | |
| SpsBase Model=LLaMA3.3-70B2026.01 | 4.83 | 2.46 | |
| EAGLE3Base Model=LLaMA3.3-70B2026.01 | 4.82 | 3.03 | |
| EAGLE3Base Model=LLaMA3.3-70B, Temperature=1, Decoding Setting=non-greedy2026.01 | 4.49 | 2.82 | |
| SpsBase Model=Deepseek-33B2026.01 | 4.18 | 2.05 | |
| SpsBase Model=LLaMA2-70B2026.01 | 4.18 | 2.03 | |
| PEARLBase Model=Qwen3-32B2026.01 | 4.12 | 1.72 | |
| PEARLBase Model=Qwen3-32B, Temperature=1, Decoding Setting=non-greedy2026.01 | 3.86 | 1.62 | |
| SpsBase Model=Qwen3-14B2026.01 | 3.38 | 1.13 | |
| SpsBase Model=Qwen3-32B2026.01 | 3.38 | 1.33 | |
| TRBase Model=Deepseek-33B2026.01 | 2.88 | 2.17 | |
| TRBase Model=LLaMA2-70B2026.01 | 2.58 | 2.21 | |
| EAGLE3Base Model=Qwen3-32B2026.01 | 2.57 | 1.73 | |
| EAGLE3Base Model=Qwen3-14B2026.01 | 2.41 | 1.58 | |
| EAGLE3Base Model=Qwen3-32B, Temperature=1, Decoding Setting=non-greedy2026.01 | 2.39 | 1.61 | |
| PLDBase Model=Deepseek-33B2026.01 | 2.07 | 1.87 | |
| PLDBase Model=LLaMA2-70B2026.01 | 1.97 | 1.77 | |
| LookaheadBase Model=Deepseek-33B2026.01 | 1.87 | 1.66 | |
| PLDBase Model=LLaMA3.3-70B2026.01 | 1.87 | 1.67 | |
| PLDBase Model=Qwen3-14B2026.01 | 1.67 | 1.53 | |
| LookaheadBase Model=LLaMA2-70B2026.01 | 1.57 | 1.27 | |
| PLDBase Model=Qwen3-32B2026.01 | 1.56 | 1.47 |