Mathematical Reasoning on GSM8K (Accuracy, Speed)
98Accuracy (GSM8K)No Defense
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No DefenseModel=Qwen3-32B (Draft-1.7B)2026.06 | 98 | 1 | |
| No DefenseModel=DeepSeek R1-70B (Draft-8B)2026.06 | 98 | 1 | |
| Spec-DecodingModel=Qwen3-32B (Draft-1.7B)2026.06 | 97 | 1.38 | |
| SRModel=Qwen3-32B (Draft-1.7B)2026.06 | 97 | 1.07 | |
| RPOModel=Qwen3-32B (Draft-1.7B)2026.06 | 97 | 1.16 | |
| SafeDecodingModel=DeepSeek R1-70B (Draft-8B)2026.06 | 97 | 0.78 | |
| SafeDecodingModel=Qwen3-32B (Draft-1.7B)2026.06 | 96 | 0.82 | |
| SafeSpecModel=Qwen3-32B (Draft-1.7B)2026.06 | 96 | 2.06 | |
| SRModel=DeepSeek R1-70B (Draft-8B)2026.06 | 96 | 1.09 | |
| SecDecodingModel=Qwen3-32B (Draft-1.7B)2026.06 | 95 | 0.61 | |
| RPOModel=DeepSeek R1-70B (Draft-8B)2026.06 | 95 | 1.12 | |
| Spec-DecodingModel=DeepSeek R1-70B (Draft-8B)2026.06 | 94 | 1.7 | |
| SecDecodingModel=DeepSeek R1-70B (Draft-8B)2026.06 | 94 | 0.57 | |
| SpecreasonModel=Qwen3-32B (Draft-1.7B)2026.06 | 93 | 2.14 | |
| Specreason+SRModel=Qwen3-32B (Draft-1.7B)2026.06 | 93 | 2.18 | |
| Specreason+RPOModel=Qwen3-32B (Draft-1.7B)2026.06 | 93 | 2.21 | |
| SpecreasonModel=DeepSeek R1-70B (Draft-8B)2026.06 | 90 | 1.81 | |
| Specreason+SRModel=DeepSeek R1-70B (Draft-8B)2026.06 | 90 | 1.94 | |
| Specreason+RPOModel=DeepSeek R1-70B (Draft-8B)2026.06 | 90 | 1.98 | |
| SafeSpecModel=DeepSeek R1-70B (Draft-8B)2026.06 | 90 | 1.76 | |
| Draft ModelModel=Qwen3-32B (Draft-1.7B)2026.06 | 86 | 6.42 | |
| Draft ModelModel=DeepSeek R1-70B (Draft-8B)2026.06 | 72 | 4.53 |