Scientific Knowledge on GPQA Diamond (out-of-distribution)
69.2AccuracySFT-S1.1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SFT-S1.1Backbone=Qwen3-4B2026.05 | 69.2 | 7.6 | |
| HINT TUNINGBackbone=Qwen3-4B2026.05 | 67.2 | 7.7 | |
| OriginalBackbone=Qwen3-4B2026.05 | 66.2 | 8.8 | |
| Budget PromptBackbone=Qwen3-4B2026.05 | 66.2 | 8.7 | |
| SFT-S1.1Backbone=DS-R1-32B2026.05 | 63.6 | 9.3 | |
| HINT TUNINGBackbone=DS-R1-32B2026.05 | 63.1 | 10.5 | |
| SFT-S1.1Backbone=DS-R1-14B2026.05 | 61.1 | 10 | |
| OriginalBackbone=DS-R1-14B2026.05 | 60.6 | 7.6 | |
| OriginalBackbone=DS-R1-32B2026.05 | 60.6 | 7.3 | |
| HINT TUNINGBackbone=DS-R1-14B2026.05 | 58.6 | 10.1 | |
| Budget PromptBackbone=DS-R1-32B2026.05 | 57.1 | 4.9 | |
| OriginalBackbone=DS-R1-7B2026.05 | 53.5 | 8.4 | |
| Budget PromptBackbone=DS-R1-14B2026.05 | 53 | 5.5 | |
| HINT TUNINGBackbone=DS-R1-7B2026.05 | 52 | 10.4 | |
| SFT-S1.1Backbone=DS-R1-7B2026.05 | 50.5 | 9.6 | |
| Budget PromptBackbone=DS-R1-7B2026.05 | 46.5 | 6.5 |