List your company
ResearchFormerly WizWand

Scientific Question Answering on GPQA (Pass@8)

79.29Pass@8MOTAB
52.5159.462566.41573.3675May 19, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MOTABStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.0579.29
SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.0577.27
SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.0576.77
SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.82026.0573.74
MOTABStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0573.74
MOTABStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0573.74
SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.0571.21
ImitKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.0570.71
SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.0570.71
SFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.0569.7
SFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0568.18
SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.0567.68
ImitKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0566.67
SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.0564.65
ImitKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0563.13
SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=1.02026.0562.63
SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.62026.0561.62
RFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.0560.1
SFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0558.59
RFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.0556.06
RFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.0553.54