Question Answering on GPQA (Score, ALm, Rej)
45.46ScoreCactus 0.75
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Cactus 0.75m (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 45.46 | 6.46 | -46 | |
| Cactus 1.0m (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 45.46 | 6.74 | -50 | |
| Cactus 0.75m (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 44.95 | 5.14 | -50 | |
| Cactus 1.0m (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 43.43 | 5.16 | -51 | |
| SpSm (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 40.91 | 3.84 | — | |
| TASm (Draft Length)=20, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 40.4 | 6.41 | -46 | |
| VerifierVerifier Model=Qwen 3 14B2026.04 | 40.07 | — | — | |
| SpSm (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 39.39 | 3.37 | — | |
| TASm (Draft Length)=10, Verifier Model=Qwen 3 14B, Drafter Model=Qwen 3 0.6B2026.04 | 38.89 | 4.99 | -46 |