Scientific Reasoning on GPQA 0-shot (test)
28.57Pass@1 AccuracydVOTING
Evaluation results
| Method | Links | ||
|---|---|---|---|
| dVOTINGGen. Len.=128, Training Necessity=Training-free, Setting=0-shot2026.02 | 28.57 | 219.3 | |
| dVOTINGGen. Len.=256, Training Necessity=Training-free, Setting=0-shot2026.02 | 28.39 | 555.7 | |
| HEXGen. Len.=256, Training Necessity=Training-free, Setting=0-shot, reimplementation=true2026.02 | 28.34 | 3,200 | |
| HEXGen. Len.=128, Training Necessity=Training-free, Setting=0-shot, reimplementation=true2026.02 | 25.67 | 1,600 | |
| Majority VotingGen. Len.=256, Training Necessity=Training-free, Setting=0-shot2026.02 | 25.45 | 640 | |
| LLaDA-8B-InstructGen. Len.=128, Training Necessity=Pre-training, Setting=0-shot2026.02 | 25 | 128 | |
| LLaDA-8B-InstructGen. Len.=256, Training Necessity=Pre-training, Setting=0-shot2026.02 | 23.66 | 256 | |
| Majority VotingGen. Len.=128, Training Necessity=Training-free, Setting=0-shot2026.02 | 22.54 | 320 |