Question Answering on GPQA Diamond (Accuracy, Length, Reflection Count)
53.13AccuracyHybrid
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HybridBase Model=Qwen3-4B, Mode=Think2026.04 | 53.13 | 7,615 | 67.01 | |
| PLEBase Model=Qwen3-4B, Mode=Think2026.04 | 48 | 25,741 | 5.14 | |
| HybridBase Model=Qwen3-4B, Mode=No-think2026.04 | 42.83 | 1,504 | 0.08 | |
| SFT-onlyBase Model=Qwen2.5-7B, Mode=Think2026.04 | 41.16 | 9,538 | 78.21 | |
| PLEBase Model=Qwen3-4B, Mode=No-think2026.04 | 40 | 402 | 0 | |
| PLEBase Model=Qwen2.5-7B, Mode=Think2026.04 | 34 | 7,044 | 12.82 | |
| InstructBase Model=Qwen2.5-7B, Mode=No-think2026.04 | 30.15 | 775 | 0 | |
| SFT-onlyBase Model=Qwen2.5-7B, Mode=No-think2026.04 | 30 | 2,910 | 3.22 | |
| PLEBase Model=Qwen2.5-7B, Mode=No-think2026.04 | 30 | 3,857 | 0 |