Rare Disease Diagnosis on MIMIC-IV Rare
29.19R@1DeepRare
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepRarebackbone=DeepSeek-V32025.06 | 29.19 | 36.6 | 39.06 | |
| DeepRarebackbone=Claude-3.72025.06 | 24.32 | 30.3 | 32.12 | |
| DeepRarebackbone=DeepSeek-R12025.06 | 23.27 | 31.16 | 34.79 | |
| DeepRarebackbone=GPT-4o2025.06 | 21.44 | 28.89 | 31.71 | |
| DS-R1-search2025.06 | 19.95 | 28.75 | 32.69 | |
| DeepRarebackbone=Gemini-22025.06 | 19.08 | — | — | |
| Gemini 2 think2025.06 | 15.47 | 20.53 | 25.39 | |
| DeepSeek V32025.06 | 14.61 | 23.04 | 26.18 | |
| Baichuan-14B2025.06 | 14.4 | 21.33 | 24.59 | |
| Gemini 22025.06 | 14.29 | 20.16 | 24.11 | |
| MMedS-Llama 32025.06 | 14.04 | 22.58 | 26.37 | |
| DeepSeek R12025.06 | 13.81 | 19.92 | 22.93 | |
| GPT-4o2025.06 | 13.76 | 22.35 | 25.6 | |
| Claude 3.7 think2025.06 | 13.7 | 21.28 | 24.32 | |
| RAGbackbone=DeepSeek-V32025.06 | 12.75 | 18.61 | 20.8 | |
| Claude-3.7-Sonnet2025.06 | 12.11 | 18.24 | 20.8 | |
| MDAgentsbackbone=GPT-4o2025.06 | 10.98 | 17.12 | 20.27 | |
| o3mini2025.06 | 10.88 | 19.52 | 23.9 | |
| MDAgentsbackbone=DeepSeek-V32025.06 | 8.69 | 15.04 | 19.41 | |
| PhenoBrain2025.06 | 8.11 | 10.24 | 11.41 | |
| PubCaseFinder2025.06 | 1.06 | 1.39 | 1.6 |