Final Diagnosis Prediction on MIMIC
93.6AccuracyCounterfactual Multi-agent Diagnostic Framework
Evaluation results
| Method | Links | |
|---|---|---|
| Counterfactual Multi-agent Diagnostic FrameworkModel=GPT-4o mini, Setting=Agents2026.03 | 93.6 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Deepseek R1, Setting=Agents2026.03 | 90.4 | |
| MDAgentsModel=GPT-4o mini, Setting=Agents2026.03 | 90.4 | |
| FS CoTModel=Deepseek R1, Setting=Prompting2026.03 | 88.5 | |
| FSModel=Deepseek R1, Setting=Prompting2026.03 | 87.8 | |
| MedAgentsModel=GPT-4o mini, Setting=Agents2026.03 | 85.3 | |
| MedAgentsModel=Deepseek R1, Setting=Agents2026.03 | 85.2 | |
| ZS CoTModel=Deepseek R1, Setting=Prompting2026.03 | 84.6 | |
| MDAgentsModel=Deepseek R1, Setting=Agents2026.03 | 84 | |
| FSModel=GPT-4o mini, Setting=Prompting2026.03 | 82.1 | |
| ZSModel=GPT-4o mini, Setting=Prompting2026.03 | 82 | |
| FS CoTModel=GPT-4o mini, Setting=Prompting2026.03 | 81.4 | |
| ZS CoTModel=GPT-4o mini, Setting=Prompting2026.03 | 80.1 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=medgemma, Setting=Agents2026.03 | 79.2 | |
| MACModel=Deepseek R1, Setting=Agents2026.03 | 78.8 | |
| MACModel=GPT-4o mini, Setting=Agents2026.03 | 78.8 | |
| ZSModel=Deepseek R1, Setting=Prompting2026.03 | 75.6 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Llama, Setting=Agents2026.03 | 75.4 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Qwen, Setting=Agents2026.03 | 72.9 | |
| FSModel=Llama, Setting=Prompting2026.03 | 71.3 | |
| ZS CoTModel=Qwen, Setting=Prompting2026.03 | 70.8 | |
| MDAgentsModel=Llama, Setting=Agents2026.03 | 70.3 | |
| FS CoTModel=Llama, Setting=Prompting2026.03 | 70 | |
| MedAgentsModel=Llama, Setting=Agents2026.03 | 69.6 | |
| FSModel=Qwen, Setting=Prompting2026.03 | 69.2 | |
| MedAgentsModel=Qwen, Setting=Agents2026.03 | 69.2 | |
| FSModel=medgemma, Setting=Prompting2026.03 | 68.8 | |
| ZSModel=Qwen, Setting=Prompting2026.03 | 68.4 | |
| FS CoTModel=Qwen, Setting=Prompting2026.03 | 67.9 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=m1-7B-23k, Setting=Agents2026.03 | 67.9 | |
| ZSModel=medgemma, Setting=Prompting2026.03 | 67.9 | |
| ZSModel=m1-7B-23k, Setting=Prompting2026.03 | 67.5 | |
| ZS CoTModel=m1-7B-23k, Setting=Prompting2026.03 | 67.5 | |
| ZS CoTModel=medgemma, Setting=Prompting2026.03 | 67.5 | |
| MDAgentsModel=Qwen, Setting=Agents2026.03 | 67.1 | |
| MedAgentsModel=medgemma, Setting=Agents2026.03 | 67.1 | |
| MACModel=Qwen, Setting=Agents2026.03 | 65.9 | |
| MDAgentsModel=medgemma, Setting=Agents2026.03 | 65.9 | |
| MDAgentsModel=m1-7B-23k, Setting=Agents2026.03 | 65 | |
| MACModel=medgemma, Setting=Agents2026.03 | 64.6 | |
| FS CoTModel=m1-7B-23k, Setting=Prompting2026.03 | 64.2 | |
| FS CoTModel=medgemma, Setting=Prompting2026.03 | 63.8 | |
| FSModel=m1-7B-23k, Setting=Prompting2026.03 | 60 | |
| MACModel=Llama, Setting=Agents2026.03 | 55.9 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=MedReason, Setting=Agents2026.03 | 55.4 | |
| ZSModel=Llama, Setting=Prompting2026.03 | 54.2 | |
| MedAgentsModel=MedReason, Setting=Agents2026.03 | 53.8 | |
| FS CoTModel=MedReason, Setting=Prompting2026.03 | 52.9 | |
| MACModel=MedReason, Setting=Agents2026.03 | 51.7 | |
| ZS CoTModel=Llama, Setting=Prompting2026.03 | 50.9 | |
| ZS CoTModel=MedReason, Setting=Prompting2026.03 | 49.2 | |
| ZSModel=MedReason, Setting=Prompting2026.03 | 48.4 | |
| MedAgentsModel=m1-7B-23k, Setting=Agents2026.03 | 47.9 | |
| MDAgentsModel=MedReason, Setting=Agents2026.03 | 47.9 | |
| FSModel=MedReason, Setting=Prompting2026.03 | 47.5 | |
| MACModel=m1-7B-23k, Setting=Agents2026.03 | 45.9 |