List your company
ResearchFormerly WizWand

Speculative Decoding on GPQA Diamond

91.17ThroughputSTAND
15.239634.952354.66574.3777Jun 5, 2025
Updated 5mo ago

Evaluation results

MethodLinks
STANDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0691.173.92.91
STANDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0687.023.72.78
STANDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0683.473.482.66
RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0671.552.732.28
RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0671.512.732.28
RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0671.232.732.27
SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0670.432.732.25
SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0669.982.742.23
SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0669.852.712.23
ANPDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0660.252.111.92
ANPDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0658.972.031.88
SAMBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0657.532.031.84
ANPDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0657.391.971.83
SAMBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0655.471.961.77
PLDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0653.471.961.71
SAMBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0653.211.871.7
PLDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0653.041.891.69
PLDBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0650.491.811.61
STANDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0649.113.862.7
STANDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0646.813.632.58
STANDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0643.713.422.41
RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0638.992.732.15
SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0638.992.712.15
RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0638.892.732.14
RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0638.812.742.14
SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0638.572.712.12
SAM+RecycleBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0638.242.712.11
Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0631.691.991.01
Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0631.691.991.01
Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0631.691.991.01
PlainBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=42025.0631.34——
PlainBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=82025.0631.34——
PlainBase Model=DeepSeek-R1-Distill-Qwen-7B, Trajectories=162025.0631.34——
ANPDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0630.622.131.69
SAMBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0630.592.061.68
ANPDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0629.512.041.63
SAMBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0629.391.951.62
PLDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0628.4321.57
ANPDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0628.211.971.55
SAMBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0628.031.851.54
PLDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0627.361.911.51
PLDBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0626.61.821.46
Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0624.862.441.37
Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0624.862.441.37
Eagle-2Base Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0624.862.441.37
PlainBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=42025.0618.16——
PlainBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=82025.0618.16——
PlainBase Model=DeepSeek-R1-Distill-Qwen-14B, Trajectories=162025.0618.16——