Speculative Decoding on AIME 2024
69.15Throughput (T)STAND
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| STANDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 69.15 | 3.46 | 2.6 | |
| STANDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 66.88 | 3.35 | 2.51 | |
| STANDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 64.99 | 3.21 | 2.44 | |
| RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 61.7 | 2.77 | 2.32 | |
| RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 61.38 | 2.76 | 2.3 | |
| SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 61.11 | 2.71 | 2.29 | |
| RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 60.86 | 2.77 | 2.29 | |
| SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 60.66 | 2.69 | 2.28 | |
| SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 60.63 | 2.68 | 2.28 | |
| SAMBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 47.64 | 1.97 | 1.79 | |
| ANPDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 47.06 | 1.96 | 1.77 | |
| PLDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 46.6 | 1.89 | 1.75 | |
| ANPDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 46.4 | 1.92 | 1.74 | |
| SAMBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 45.64 | 1.89 | 1.71 | |
| ANPDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 45.52 | 1.89 | 1.71 | |
| PLDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 44.95 | 1.84 | 1.69 | |
| SAMBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 44.35 | 1.81 | 1.67 | |
| PLDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 43.93 | 1.78 | 1.65 | |
| STANDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 40.76 | 3.42 | 2.3 | |
| STANDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 39.13 | 3.28 | 2.2 | |
| STANDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 37.56 | 3.16 | 2.11 | |
| SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 35.53 | 2.72 | 2 | |
| RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 35.31 | 2.77 | 1.99 | |
| SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 35.16 | 2.71 | 1.98 | |
| RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 35.06 | 2.77 | 1.97 | |
| RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 34.97 | 2.78 | 1.97 | |
| SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 34.81 | 2.7 | 1.96 | |
| Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 29.91 | 2.21 | 1.12 | |
| Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 29.91 | 2.21 | 1.12 | |
| Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 29.91 | 2.21 | 1.12 | |
| SAMBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 27.25 | 1.98 | 1.53 | |
| PlainBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.06 | 26.63 | — | — | |
| PlainBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.06 | 26.63 | — | — | |
| PlainBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.06 | 26.63 | — | — | |
| ANPDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 26.49 | 1.96 | 1.49 | |
| PLDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 26.35 | 1.92 | 1.48 | |
| ANPDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 26.12 | 1.91 | 1.47 | |
| SAMBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 26.11 | 1.88 | 1.47 | |
| ANPDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 25.74 | 1.87 | 1.45 | |
| PLDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 25.44 | 1.84 | 1.43 | |
| Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 25.38 | 2.72 | 1.43 | |
| Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 25.38 | 2.72 | 1.43 | |
| Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 25.38 | 2.72 | 1.43 | |
| SAMBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 25.22 | 1.78 | 1.42 | |
| PLDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 24.37 | 1.74 | 1.37 | |
| PlainBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.06 | 17.76 | — | — | |
| PlainBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.06 | 17.76 | — | — | |
| PlainBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.06 | 17.76 | — | — |