List your company
ResearchFormerly WizWand

Accuracy and F1 on MedQA (Medical Reasoning)

83.76AccuracyCOTCAgent
68.794472.679776.56580.4503May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
COTCAgentBackbone=Baichuan-M22026.0583.7682.9
KAREBackbone=Baichuan-M22026.0582.8481.7
API toolsBackbone=Baichuan-M22026.0582.3380.6
COTCAgentBackbone=Gemini 2.5 Pro2026.0581.7680.2
Google'sBackbone=Baichuan-M22026.0581.6679.7
COTCAgentBackbone=Claude 3.7 Sonnet2026.0581.4880.1
COTCAgentBackbone=GPT-4o2026.0581.1479.9
DirPredBackbone=Baichuan-M22026.0580.7678.8
TimeCAPBackbone=Baichuan-M22026.0579.3877.7
KAREBackbone=Gemini 2.5 Pro2026.0579.2877.9
KAREBackbone=Claude 3.7 Sonnet2026.0578.9677.5
API toolsBackbone=Gemini 2.5 Pro2026.0578.8478.1
KAREBackbone=GPT-4o2026.0578.7676.8
API toolsBackbone=Claude 3.7 Sonnet2026.0578.5177.4
API toolsBackbone=GPT-4o2026.0578.2976.6
Google'sBackbone=Gemini 2.5 Pro2026.0578.1676.9
Google'sBackbone=Claude 3.7 Sonnet2026.0577.7376.1
Google'sBackbone=GPT-4o2026.0577.5975.8
DirPredBackbone=Gemini 2.5 Pro2026.0577.5175.8
DirPredBackbone=Claude 3.7 Sonnet2026.0577.3675.6
DirPredBackbone=GPT-4o2026.0577.0874.8
TimeCAPBackbone=Gemini 2.5 Pro2026.0576.0474.7
TimeCAPBackbone=Claude 3.7 Sonnet2026.0575.9874.6
TimeCAPBackbone=GPT-4o2026.0575.7173.6
COTCAgentBackbone=Qwen3-Next-80B-A3B2026.0574.0671.9
KAREBackbone=Qwen3-Next-80B-A3B2026.0572.1470.8
API toolsBackbone=Qwen3-Next-80B-A3B2026.0571.5370.3
Google'sBackbone=Qwen3-Next-80B-A3B2026.0571.2869.7
DirPredBackbone=Qwen3-Next-80B-A3B2026.0570.6269.1
TimeCAPBackbone=Qwen3-Next-80B-A3B2026.0569.3768.1