Question Answering on GPQA-D (∆Acc, CR)
100Coverage RateVanilla
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VanillaAccess=—, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 100 | — | |
| VanillaAccess=—, Base Model=QwQ-32B (DEER) / Qwen3-32B-Think (ours)2026.04 | 100 | — | |
| DEERAccess=semi-white, Base Model=QwQ-32B (DEER) / Qwen3-32B-Think (ours)2026.04 | 84 | 0.7 | |
| DEER-PRoAccess=semi-white, Base Model=QwQ-32B (DEER) / Qwen3-32B-Think (ours)2026.04 | 84 | 0.9 | |
| TCCAccess=black-box, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 61 | 0.5 | |
| DEER-PRoAccess=semi-white, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 55 | 0.9 | |
| BAEEAccess=black-box, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 51 | 2 | |
| Dynasor-CoTAccess=black-box, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 40 | 0.4 | |
| DEERAccess=semi-white, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 40 | 0.8 | |
| BAEEAccess=black-box, Base Model=QwQ-32B (DEER) / Qwen3-32B-Think (ours)2026.04 | 33 | 1 | |
| NoThinkingAccess=black-box, Base Model=Qwen3-14B (DEER) / Qwen3-8B-Think (ours)2026.04 | 32 | 9.5 |