Question Answering on GPQA (Throughput, Speedup, Acceptance Length)
75.39ThroughputSTAND
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| STANDBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 75.39 | 2.41 | 3.05 | |
| SAM+RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 71.51 | 2.28 | 2.81 | |
| RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 71 | 2.27 | 2.71 | |
| ANPDBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 54.05 | 1.72 | 1.82 | |
| SAMBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 48.45 | 1.55 | 1.69 | |
| PLDBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 42.84 | 1.37 | 1.64 | |
| RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 38.91 | 2.14 | 2.73 | |
| STANDBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 38.71 | 2.13 | 3 | |
| SAM+RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 37.53 | 2.07 | 2.72 | |
| Eagle-2Backbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 31.69 | 1.01 | 1.99 | |
| PlainBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.06 | 31.34 | — | — | |
| ANPDBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 26.4 | 1.45 | 1.79 | |
| SAMBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 25.38 | 1.4 | 1.65 | |
| PLDBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 24.97 | 1.38 | 1.64 | |
| Eagle-2Backbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 24.86 | 1.37 | 2.44 | |
| PlainBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.06 | 18.16 | — | — |