Scientific Reasoning on GPQA (Accuracy, Speed)
63AccuracySR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SRModel=DeepSeek R1-70B (Draft-8B)2026.06 | 63 | 1.09 | |
| No DefenseModel=DeepSeek R1-70B (Draft-8B)2026.06 | 62 | 1 | |
| RPOModel=DeepSeek R1-70B (Draft-8B)2026.06 | 62 | 1.12 | |
| SafeDecodingModel=DeepSeek R1-70B (Draft-8B)2026.06 | 61 | 0.78 | |
| SafeSpecModel=DeepSeek R1-70B (Draft-8B)2026.06 | 61 | 1.76 | |
| Specreason+SRModel=Qwen3-32B (Draft-1.7B)2026.06 | 60 | 2.18 | |
| Spec-DecodingModel=DeepSeek R1-70B (Draft-8B)2026.06 | 60 | 1.7 | |
| SpecreasonModel=DeepSeek R1-70B (Draft-8B)2026.06 | 60 | 1.81 | |
| Specreason+SRModel=DeepSeek R1-70B (Draft-8B)2026.06 | 60 | 1.94 | |
| No DefenseModel=Qwen3-32B (Draft-1.7B)2026.06 | 58 | 1 | |
| SecDecodingModel=DeepSeek R1-70B (Draft-8B)2026.06 | 58 | 0.57 | |
| Specreason+RPOModel=DeepSeek R1-70B (Draft-8B)2026.06 | 57 | 1.98 | |
| SecDecodingModel=Qwen3-32B (Draft-1.7B)2026.06 | 56 | 0.61 | |
| Spec-DecodingModel=Qwen3-32B (Draft-1.7B)2026.06 | 55 | 1.38 | |
| SRModel=Qwen3-32B (Draft-1.7B)2026.06 | 55 | 1.07 | |
| SafeDecodingModel=Qwen3-32B (Draft-1.7B)2026.06 | 55 | 0.82 | |
| RPOModel=Qwen3-32B (Draft-1.7B)2026.06 | 54 | 1.16 | |
| SpecreasonModel=Qwen3-32B (Draft-1.7B)2026.06 | 53 | 2.14 | |
| Specreason+RPOModel=Qwen3-32B (Draft-1.7B)2026.06 | 53 | 2.21 | |
| SafeSpecModel=Qwen3-32B (Draft-1.7B)2026.06 | 52 | 2.06 | |
| Draft ModelModel=DeepSeek R1-70B (Draft-8B)2026.06 | 45 | 4.53 | |
| Draft ModelModel=Qwen3-32B (Draft-1.7B)2026.06 | 22 | 6.42 |