Reasoning on HeadQA
77.9Pass@1PSFT
Evaluation Results
| Method | Links | |
|---|---|---|
| PSFTBackbone=Llama3.1-8B-Instruct2025.08 | 77.9 | |
| PSFTwarm-upBackbone=Llama3.1-8B-Instruct2025.08 | 77.71 | |
| PSFTBackbone=Qwen2.5-7B-Instruct2025.08 | 75.82 | |
| PSFTwarm-upBackbone=Qwen2.5-7B-Instruct2025.08 | 75.24 | |
| SFTBackbone=Qwen2.5-7B-Instruct2025.08 | 74.65 | |
| SFT-KLBackbone=Qwen2.5-7B-Instruct2025.08 | 74.07 | |
| SFTBackbone=Llama3.1-8B-Instruct2025.08 | 73.52 | |
| BaseBackbone=Qwen2.5-7B-Instruct2025.08 | 73.41 | |
| SFT-KLBackbone=Llama3.1-8B-Instruct2025.08 | 71.95 | |
| BaseBackbone=Llama3.1-8B-Instruct2025.08 | 68.2 |