List your company
ResearchFormerly WizWand

Tool Use on tau-bench retail domain

57AccuracyQwen2.5-72B-CodeGym
2.416.57530.7544.925Sep 22, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Qwen2.5-72B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=72B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0957
Qwen2.5-32B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0954.4
Qwen2.5-72B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=72B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0949.2
QwQ-32B-CodeGymCoT Pattern=Long-CoT, Training Strategy=CodeGym, Model Series=QwQ, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0943
Qwen2.5-32B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0941.4
Qwen2.5-14B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=14B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0939.2
QwQ-32BCoT Pattern=Long-CoT, Training Strategy=Base, Model Series=QwQ, Model Size=32B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0937.7
Qwen2.5-14B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=14B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.0932
Qwen2.5-7B-CodeGymCoT Pattern=Short-CoT, Training Strategy=CodeGym, Model Series=Qwen2.5, Model Size=7B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.097.6
Qwen2.5-7B-InstructCoT Pattern=Short-CoT, Training Strategy=Instruct, Model Series=Qwen2.5, Model Size=7B, T=0.7, top-p=0.95, Inference Averaging=5 runs2025.094.5