List your company
ResearchFormerly WizWand

Reasoning on HeadQA

77.9Pass@1PSFT
67.81270.43173.0575.669Aug 25, 2025
Updated 6mo ago

Evaluation results

MethodLinks
PSFTBackbone=Llama3.1-8B-Instruct2025.0877.9
PSFTwarm-upBackbone=Llama3.1-8B-Instruct2025.0877.71
PSFTBackbone=Qwen2.5-7B-Instruct2025.0875.82
PSFTwarm-upBackbone=Qwen2.5-7B-Instruct2025.0875.24
SFTBackbone=Qwen2.5-7B-Instruct2025.0874.65
SFT-KLBackbone=Qwen2.5-7B-Instruct2025.0874.07
SFTBackbone=Llama3.1-8B-Instruct2025.0873.52
BaseBackbone=Qwen2.5-7B-Instruct2025.0873.41
SFT-KLBackbone=Llama3.1-8B-Instruct2025.0871.95
BaseBackbone=Llama3.1-8B-Instruct2025.0868.2