List your company
ResearchFormerly WizWand

Mathematical Reasoning on AIME 2024 (Avg@32 and Pass@32)

42.7Avg@32SCOPE (Ours)
2.1412.6723.233.73Apr 12, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SCOPE (Ours)Teacher Model=SkyWork-OR1-Math-7B, Student Model=DeepSeek-R1-Distill-Qwen-1.5B2026.0442.777.9
w/ OPDTeacher Model=SkyWork-OR1-Math-7B, Student Model=DeepSeek-R1-Distill-Qwen-1.5B2026.0440.275
w/ GRPOTeacher Model=SkyWork-OR1-Math-7B, Student Model=DeepSeek-R1-Distill-Qwen-1.5B2026.0435.568.3
R1-Distill-Qwen-1.5BTeacher Model=SkyWork-OR1-Math-7B, Student Model=DeepSeek-R1-Distill-Qwen-1.5B2026.0429.476.5
w/ KDTeacher Model=SkyWork-OR1-Math-7B, Student Model=DeepSeek-R1-Distill-Qwen-1.5B2026.0426.671.4
SCOPE (Ours)Teacher Model=Qwen3-8B-Instruct, Student Model=Qwen3-1.7B-Base2026.0413.331.5
w/ OPDTeacher Model=Qwen3-8B-Instruct, Student Model=Qwen3-1.7B-Base2026.0412.231.5
w/ GRPOTeacher Model=Qwen3-8B-Instruct, Student Model=Qwen3-1.7B-Base2026.047.527.2
w/ KDTeacher Model=Qwen3-8B-Instruct, Student Model=Qwen3-1.7B-Base2026.044.618.9
Qwen3-1.7B-BaseTeacher Model=Qwen3-8B-Instruct, Student Model=Qwen3-1.7B-Base2026.043.726.7