Chain-of-Thought Reasoning on GPQA Diamond
67.93AccuracyVanilla
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VanillaModel=Qwen3-14B2026.06 | 67.93 | 5,988 | — | |
| CUSUMModel=Qwen3-14B2026.06 | 67.68 | 5,720 | 4.5 | |
| CUSUMModel=Qwen3-4B-Thinking-25072026.06 | 64.9 | 8,980 | 4.9 | |
| VanillaModel=Qwen3-4B-Thinking-25072026.06 | 64.65 | 9,442 | — | |
| DEERModel=Qwen3-4B-Thinking-25072026.06 | 64.65 | 9,082 | 3.8 | |
| DynasorModel=Qwen3-4B-Thinking-25072026.06 | 63.14 | 8,968 | 5 | |
| DEERModel=Qwen3-14B2026.06 | 62 | 5,942 | 0.8 | |
| DynasorModel=Qwen3-14B2026.06 | 61.99 | 5,902 | 1.4 | |
| CUSUMModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 40.4 | 8,191 | 5.2 | |
| VanillaModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 38.38 | 8,637 | — | |
| DEERModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 35.73 | 8,227 | 4.8 | |
| DynasorModel=DeepSeek-R1-Distill-Qwen-7B2026.06 | 19.32 | 8,342 | 3.4 |