Scientific Reasoning on GPQA-D
67.2Pass@1REBALANCE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| REBALANCEBackbone=Qwen3-14B2026.03 | 67.2 | — | — | — | 5 | |
| REBALANCEBackbone=QwQ-32B2026.03 | 67.2 | — | — | — | 6 | |
| BaselineBackbone=QwQ-32B2026.03 | 63.1 | — | — | — | 7 | |
| BaselineBackbone=Qwen3-14B2026.03 | 60.6 | — | — | — | 7 | |
| Pass@1Model=Qwen3-4B, Number of repeated trials=162026.02 | 59.79 | — | — | — | — | |
| Pass@1Model=DeepSeek-8B, Number of repeated trials=162026.02 | 59.17 | — | — | — | — | |
| REBALANCEBackbone=DeepSeek-R1-Distill-Qwen-7B2026.03 | 39.4 | — | — | — | 5 | |
| BaselineBackbone=DeepSeek-R1-Distill-Qwen-7B2026.03 | 33.8 | — | — | — | 7 | |
| REBALANCEBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.03 | 21.7 | — | — | — | 6 | |
| Pass@1Model=DeepSeek-1.5B, Number of repeated trials=162026.02 | 21.67 | — | — | — | — | |
| BaselineBackbone=DeepSeek-R1-Distill-Qwen-1.5B2026.03 | 17.1 | — | — | — | 8 | |
| Chronos@128Model=DeepSeek-1.5B, Number of repeated trials=16, Trajectories=1282026.02 | — | — | — | 39.17 | — | |
| Chronos@128Model=Qwen3-4B, Number of repeated trials=16, Trajectories=1282026.02 | — | — | — | 71.25 | — | |
| Chronos@128Model=DeepSeek-8B, Number of repeated trials=16, Trajectories=1282026.02 | — | — | — | 71.25 | — | |
| DeepConf@128Model=DeepSeek-1.5B, Number of repeated trials=16, Trajectories=1282026.02 | — | — | 36.88 | — | — | |
| DeepConf@128Model=Qwen3-4B, Number of repeated trials=16, Trajectories=1282026.02 | — | — | 68.96 | — | — | |
| DeepConf@128Model=DeepSeek-8B, Number of repeated trials=16, Trajectories=1282026.02 | — | — | 70.21 | — | — | |
| Maj@128Model=DeepSeek-1.5B, Number of repeated trials=16, Trajectories=1282026.02 | — | 33.96 | — | — | — | |
| Maj@128Model=Qwen3-4B, Number of repeated trials=16, Trajectories=1282026.02 | — | 70.83 | — | — | — | |
| Maj@128Model=DeepSeek-8B, Number of repeated trials=16, Trajectories=1282026.02 | — | 67.92 | — | — | — |