Final Diagnosis Prediction on MedCaseReasoning
66AccuracyCounterfactual Multi-agent Diagnostic Framework
Evaluation results
| Method | Links | |
|---|---|---|
| Counterfactual Multi-agent Diagnostic FrameworkModel=GPT-4o mini, Setting=Agents2026.03 | 66 | |
| MDAgentsModel=GPT-4o mini, Setting=Agents2026.03 | 60.7 | |
| MACModel=GPT-4o mini, Setting=Agents2026.03 | 59.3 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Deepseek R1, Setting=Agents2026.03 | 54 | |
| FSModel=GPT-4o mini, Setting=Prompting2026.03 | 52 | |
| FS CoTModel=GPT-4o mini, Setting=Prompting2026.03 | 52 | |
| FS CoTModel=Deepseek R1, Setting=Prompting2026.03 | 50.7 | |
| ZSModel=GPT-4o mini, Setting=Prompting2026.03 | 50.7 | |
| MedAgentsModel=Deepseek R1, Setting=Agents2026.03 | 49.3 | |
| ZS CoTModel=GPT-4o mini, Setting=Prompting2026.03 | 47.3 | |
| MedAgentsModel=GPT-4o mini, Setting=Agents2026.03 | 47.3 | |
| ZS CoTModel=Deepseek R1, Setting=Prompting2026.03 | 44.7 | |
| FSModel=Deepseek R1, Setting=Prompting2026.03 | 44.7 | |
| ZSModel=Deepseek R1, Setting=Prompting2026.03 | 42 | |
| MACModel=Deepseek R1, Setting=Agents2026.03 | 40.7 | |
| MDAgentsModel=Deepseek R1, Setting=Agents2026.03 | 38.7 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Qwen, Setting=Agents2026.03 | 26.3 | |
| ZSModel=Qwen, Setting=Prompting2026.03 | 25.3 | |
| ZS CoTModel=Qwen, Setting=Prompting2026.03 | 25.3 | |
| MedAgentsModel=Qwen, Setting=Agents2026.03 | 24.7 | |
| FSModel=Qwen, Setting=Prompting2026.03 | 23.3 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=m1-7B-23k, Setting=Agents2026.03 | 23.3 | |
| FS CoTModel=Qwen, Setting=Prompting2026.03 | 23 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Llama, Setting=Agents2026.03 | 22.7 | |
| MDAgentsModel=Qwen, Setting=Agents2026.03 | 22 | |
| MACModel=Qwen, Setting=Agents2026.03 | 21.3 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=medgemma, Setting=Agents2026.03 | 21 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=MedReason, Setting=Agents2026.03 | 20.3 | |
| ZSModel=m1-7B-23k, Setting=Prompting2026.03 | 20 | |
| MDAgentsModel=m1-7B-23k, Setting=Agents2026.03 | 19 | |
| MDAgentsModel=Llama, Setting=Agents2026.03 | 18.7 | |
| ZS CoTModel=m1-7B-23k, Setting=Prompting2026.03 | 18.7 | |
| MDAgentsModel=MedReason, Setting=Agents2026.03 | 18.7 | |
| MACModel=medgemma, Setting=Agents2026.03 | 18.3 | |
| ZS CoTModel=Llama, Setting=Prompting2026.03 | 18 | |
| MedAgentsModel=MedReason, Setting=Agents2026.03 | 18 | |
| ZSModel=medgemma, Setting=Prompting2026.03 | 18 | |
| FSModel=Llama, Setting=Prompting2026.03 | 17.7 | |
| ZS CoTModel=medgemma, Setting=Prompting2026.03 | 17.7 | |
| ZSModel=Llama, Setting=Prompting2026.03 | 17.3 | |
| MACModel=Llama, Setting=Agents2026.03 | 17.3 | |
| ZSModel=MedReason, Setting=Prompting2026.03 | 17.3 | |
| MedAgentsModel=Llama, Setting=Agents2026.03 | 16.3 | |
| MACModel=m1-7B-23k, Setting=Agents2026.03 | 16.3 | |
| MACModel=MedReason, Setting=Agents2026.03 | 16.3 | |
| MedAgentsModel=m1-7B-23k, Setting=Agents2026.03 | 16 | |
| FSModel=medgemma, Setting=Prompting2026.03 | 15.3 | |
| FS CoTModel=Llama, Setting=Prompting2026.03 | 14.3 | |
| FSModel=m1-7B-23k, Setting=Prompting2026.03 | 13.7 | |
| ZS CoTModel=MedReason, Setting=Prompting2026.03 | 13 | |
| FS CoTModel=medgemma, Setting=Prompting2026.03 | 12.7 | |
| MDAgentsModel=medgemma, Setting=Agents2026.03 | 12.7 | |
| FS CoTModel=MedReason, Setting=Prompting2026.03 | 12 | |
| MedAgentsModel=medgemma, Setting=Agents2026.03 | 11.3 | |
| FS CoTModel=m1-7B-23k, Setting=Prompting2026.03 | 11 | |
| FSModel=MedReason, Setting=Prompting2026.03 | 8 |