Clinical Question Answering on LiveClin Multimodal (offline)
74.59AccuracySkeMex
Evaluation results
| Method | Links | |
|---|---|---|
| SkeMexBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 74.59 | |
| SkillWeaverBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 71.35 | |
| VoyagerBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| GMBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| MempBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| AWMBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| DCBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| MobileEBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| GSEMBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.81 | |
| ReflexionBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.27 | |
| ExPeLBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.27 | |
| Agent KBBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 70.27 | |
| EvolverBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 69.73 | |
| CFMBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 69.73 | |
| CRITICBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 68.65 | |
| DILUBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 68.65 | |
| VoyagerBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 61.62 | |
| GSEMBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 61.62 | |
| SkeMexBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 61.62 | |
| ReActBackbone=Qwen3.6-Plus, Setting=Offline2026.06 | 60.54 | |
| CoTBackbone=MedGemma-27B, Setting=Offline2026.06 | 59.46 | |
| CRITICBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 59.46 | |
| DILUBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 59.46 | |
| ExPeLBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 59.46 | |
| CFMBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 59.46 | |
| CoTBackbone=HuluMed-32B, Setting=Offline2026.06 | 58.92 | |
| CoTBackbone=Lingshu-32B, Setting=Offline2026.06 | 58.92 | |
| ReflexionBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 58.92 | |
| AWMBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 58.92 | |
| Agent KBBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 58.92 | |
| MobileEBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 58.92 | |
| ReActBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 58.38 | |
| GMBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 57.84 | |
| EvolverBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 57.84 | |
| CoTBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 57.3 | |
| SkillWeaverBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 57.3 | |
| DCBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 56.76 | |
| MempBackbone=DeepSeek-V3.2, Setting=Offline2026.06 | 56.22 |