Rare Disease Diagnosis on DDD
47.59Recall@1DeepRare
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeepRarebackbone=Gemini-22025.06 | 47.59 | 59.82 | 62.7 | |
| DeepRarebackbone=Claude-3.72025.06 | 45.49 | 58.85 | 63.76 | |
| DeepRarebackbone=DeepSeek-R12025.06 | 44.27 | 57.09 | 61.27 | |
| DeepRarebackbone=DeepSeek-V32025.06 | 42.97 | 53.48 | 56.72 | |
| DeepRarebackbone=GPT-4o2025.06 | 39.85 | 51.36 | 55.88 | |
| RAGbackbone=DeepSeek-V32025.06 | 39.42 | 48.84 | 51.77 | |
| PhenoBrain2025.06 | 38.92 | 54.68 | 63.11 | |
| DeepSeek R12025.06 | 38.24 | 49.43 | 53.01 | |
| Gemini 2 think2025.06 | 34.43 | 46.33 | 50.02 | |
| o3mini2025.06 | 34.09 | 42.96 | 45.5 | |
| DeepSeek V32025.06 | 34.01 | 45.27 | 48.83 | |
| Claude 3.7 think2025.06 | 34.01 | 45.27 | 48.83 | |
| GPT-4o2025.06 | 33.3 | 42.28 | 45.18 | |
| DS-R1-search2025.06 | 32.3 | 47.15 | 52.41 | |
| Claude-3.7-Sonnet2025.06 | 32.28 | 42.76 | 45.93 | |
| Gemini 22025.06 | 31.32 | 43.6 | 53.03 | |
| Baichuan-14B2025.06 | 29.32 | 39.37 | 44.29 | |
| PubCaseFinder2025.06 | 26.92 | 32.32 | 34.05 | |
| MDAgentsbackbone=DeepSeek-V32025.06 | 25.76 | 32.33 | 34.69 | |
| MDAgentsbackbone=GPT-4o2025.06 | 25.01 | 33.33 | 36.01 | |
| MMedS-Llama 32025.06 | 22.18 | 33.8 | 38.34 |