List your company
ResearchFormerly WizWand

Tool Use Accuracy on tau2-Bench

80.3AccuracyMOPD
-0.50820.47141.4562.429Sep 22, 2025Nov 7, 2025Dec 24, 2025Feb 9, 2026Mar 27, 2026May 13, 2026Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
MOPDModel=MiMo-V2-Flash2026.0680.3
TeacherModel=MiMo-V2-Flash, Status=RL-trained2026.0679.6
StudentModel=MiMo-V2-Flash2026.0675.9
Qwen2.5-32B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0930.7
QwQ-32B-CodeGymCoT Pattern=Long-CoT, Training Strategy=CodeGym, Model Series=QwQ, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0930.7
QwQ-32BCoT Pattern=Long-CoT, Training Strategy=Base, Model Series=QwQ, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0926.1
Qwen2.5-72B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=72B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0925.8
Qwen2.5-32B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0924.7
Qwen2.5-72B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=72B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0922.6
Qwen2.5-14B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=14B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0920.9
Qwen2.5-14B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=14B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0919.9
Qwen2.5-7B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=7B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0915.5
Youtu-LLM 2BNon-thinking Mode=true, temperature=1, top-p=0.95, top-k=20, presence penalty=1.52025.1215
Qwen2.5-7B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=7B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0914.9
Qwen3 4BNon-thinking Mode=true, temperature=1, top-p=0.95, top-k=20, presence penalty=1.52025.1210.9
SmolLM3 3BNon-thinking Mode=true, temperature=1, top-p=0.95, top-k=20, presence penalty=1.52025.129.7
Qwen3 1.7BNon-thinking Mode=true, temperature=1, top-p=0.95, top-k=20, presence penalty=1.52025.122.6