List your company
ResearchFormerly WizWand

Mathematical Reasoning on AIME24 (Pass@8, Pass@4, Pass@1)

50Pass@8MOTAB
8.419.23040.8May 19, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MOTABStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.055041.3822.08
SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.82026.0543.3334.7114.58
SFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0536.6725.99.58
ImitKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0536.6730.1916.25
MOTABStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.053023.3310.42
SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.0526.6722.0510
SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.62026.0523.3317.577.92
SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=1.02026.0523.3318.5710.83
MOTABStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0523.3313.765
SFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.0523.3319.7610.42
SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.0523.3319.2410
SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.052011.672.92
ImitKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.052016.195.83
SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.052013.334.17
SFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0516.6711.193.33
ImitKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0516.679.762.92
SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.0516.678.332.08
SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.0516.6712.383.75
RFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.0516.6712.865.42
RFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0513.3311.385.83
RFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05107.382.5