Final Diagnosis Prediction on ER-Reason
26.7AccuracyFS CoT
Evaluation results
| Method | Links | |
|---|---|---|
| FS CoTModel=medgemma, Setting=Prompting2026.03 | 26.7 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=GPT-4o mini, Setting=Agents2026.03 | 26.7 | |
| FSModel=medgemma, Setting=Prompting2026.03 | 25.4 | |
| MDAgentsModel=GPT-4o mini, Setting=Agents2026.03 | 23.3 | |
| FS CoTModel=GPT-4o mini, Setting=Prompting2026.03 | 22.7 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=medgemma, Setting=Agents2026.03 | 22.5 | |
| FSModel=GPT-4o mini, Setting=Prompting2026.03 | 22 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Qwen, Setting=Agents2026.03 | 21.3 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Deepseek R1, Setting=Agents2026.03 | 21.3 | |
| FS CoTModel=Qwen, Setting=Prompting2026.03 | 20.5 | |
| FSModel=Qwen, Setting=Prompting2026.03 | 20 | |
| ZSModel=GPT-4o mini, Setting=Prompting2026.03 | 19.3 | |
| MACModel=Qwen, Setting=Agents2026.03 | 19.2 | |
| FSModel=m1-7B-23k, Setting=Prompting2026.03 | 19.2 | |
| FS CoTModel=m1-7B-23k, Setting=Prompting2026.03 | 19.2 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=m1-7B-23k, Setting=Agents2026.03 | 19.2 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=Llama, Setting=Agents2026.03 | 18.8 | |
| Counterfactual Multi-agent Diagnostic FrameworkModel=MedReason, Setting=Agents2026.03 | 18.8 | |
| MDAgentsModel=medgemma, Setting=Agents2026.03 | 18.8 | |
| MDAgentsModel=Qwen, Setting=Agents2026.03 | 18.4 | |
| ZS CoTModel=medgemma, Setting=Prompting2026.03 | 18.4 | |
| ZSModel=m1-7B-23k, Setting=Prompting2026.03 | 18 | |
| ZS CoTModel=GPT-4o mini, Setting=Prompting2026.03 | 18 | |
| MedAgentsModel=GPT-4o mini, Setting=Agents2026.03 | 18 | |
| FS CoTModel=Llama, Setting=Prompting2026.03 | 17.9 | |
| ZSModel=Qwen, Setting=Prompting2026.03 | 17.5 | |
| ZS CoTModel=m1-7B-23k, Setting=Prompting2026.03 | 17.5 | |
| MDAgentsModel=Deepseek R1, Setting=Agents2026.03 | 17.3 | |
| FSModel=Llama, Setting=Prompting2026.03 | 17.1 | |
| FS CoTModel=MedReason, Setting=Prompting2026.03 | 17.1 | |
| MACModel=medgemma, Setting=Agents2026.03 | 17.1 | |
| ZS CoTModel=Qwen, Setting=Prompting2026.03 | 16.7 | |
| ZS CoTModel=Deepseek R1, Setting=Prompting2026.03 | 16.7 | |
| ZSModel=medgemma, Setting=Prompting2026.03 | 16.3 | |
| MDAgentsModel=Llama, Setting=Agents2026.03 | 15.9 | |
| MedAgentsModel=Qwen, Setting=Agents2026.03 | 15.9 | |
| MedAgentsModel=MedReason, Setting=Agents2026.03 | 15.9 | |
| MDAgentsModel=m1-7B-23k, Setting=Agents2026.03 | 15.4 | |
| MACModel=GPT-4o mini, Setting=Agents2026.03 | 15.3 | |
| MACModel=MedReason, Setting=Agents2026.03 | 15 | |
| FSModel=MedReason, Setting=Prompting2026.03 | 14.6 | |
| MDAgentsModel=MedReason, Setting=Agents2026.03 | 14.2 | |
| MedAgentsModel=medgemma, Setting=Agents2026.03 | 14.2 | |
| ZSModel=Deepseek R1, Setting=Prompting2026.03 | 14 | |
| FS CoTModel=Deepseek R1, Setting=Prompting2026.03 | 14 | |
| MACModel=Llama, Setting=Agents2026.03 | 13.8 | |
| FSModel=Deepseek R1, Setting=Prompting2026.03 | 13.3 | |
| MedAgentsModel=Llama, Setting=Agents2026.03 | 12.9 | |
| MedAgentsModel=m1-7B-23k, Setting=Agents2026.03 | 12.1 | |
| MACModel=m1-7B-23k, Setting=Agents2026.03 | 11.3 | |
| MedAgentsModel=Deepseek R1, Setting=Agents2026.03 | 11.3 | |
| ZSModel=MedReason, Setting=Prompting2026.03 | 10.9 | |
| ZS CoTModel=MedReason, Setting=Prompting2026.03 | 10.9 | |
| ZSModel=Llama, Setting=Prompting2026.03 | 10.5 | |
| MACModel=Deepseek R1, Setting=Agents2026.03 | 9.3 | |
| ZS CoTModel=Llama, Setting=Prompting2026.03 | 8.4 |