Medical Reasoning on MedDDx
48.2Basic AccuracyMedLA+LLaMA3.1(8B)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MedLA+LLaMA3.1(8B)Method Category=Logic Based, Model Scale=8B2025.09 | 48.2 | 43 | 41.7 | 44.3 | |
| CoT-LLaMA3.1Method Category=General & Medical LLMs with COT, Model Scale=8B, Chain-of-Thought=true2025.09 | 43.9 | 39.3 | 32.2 | 38.5 | |
| LLaMA3.1(8B)[baseline]Method Category=General & Medical LLMs, Model Scale=8B2025.09 | 43.4 | 36.8 | 30.6 | 36.9 | |
| CoT-LLaMA3Method Category=General & Medical LLMs with COT, Model Scale=8B, Chain-of-Thought=true2025.09 | 43.4 | 36.8 | 31.3 | 37.2 | |
| LLaMA3Method Category=General & Medical LLMs, Model Scale=8B2025.09 | 42.8 | 31.9 | 30.6 | 35.1 | |
| MDAgentsMethod Category=Multi Agents Methods2025.09 | 42.1 | 37.5 | 33.4 | 37.7 | |
| MistralMethod Category=General & Medical LLMs, Model Scale=7B2025.09 | 41.2 | 35.6 | 37.5 | 38.1 | |
| MedAgentsMethod Category=Multi Agents Methods2025.09 | 41 | 35.7 | 32.9 | 36.5 | |
| CoT-MistralMethod Category=General & Medical LLMs with COT, Model Scale=7B, Chain-of-Thought=true2025.09 | 40.4 | 36.8 | 37.9 | 38.4 | |
| MedAlpacaMethod Category=General & Medical LLMs, Model Scale=7B2025.09 | 39.9 | 32.5 | 31.1 | 34.5 | |
| MV-LLaMA3.1Method Category=Multi Agents Methods, Model Scale=8B2025.09 | 39.6 | 32.8 | 30.2 | 34.2 | |
| CoT-MedAlpacaMethod Category=General & Medical LLMs with COT, Model Scale=7B, Chain-of-Thought=true2025.09 | 39.5 | 32.1 | 31.2 | 34.3 | |
| DyLANMethod Category=Multi Agents Methods2025.09 | 39.3 | 33.5 | 31.1 | 34.6 | |
| MedRAGMethod Category=RAG & Based Methods, Model Scale=70B2025.09 | 36.5 | 34.8 | 32.7 | 34.7 | |
| QAGNNMethod Category=Graph Based Methods2025.09 | 29.5 | 26.5 | 25.3 | 27.1 | |
| DragonMethod Category=Graph Based Methods2025.09 | 28.6 | 24.7 | 24 | 25.8 | |
| KG-RankMethod Category=RAG & Based Methods, Model Scale=13B2025.09 | 25.3 | 25.6 | 23.4 | 24.8 | |
| Self-RAGMethod Category=RAG & Based Methods, Model Scale=13B2025.09 | 24.9 | 29 | 26.6 | 26.8 | |
| JointLKMethod Category=Graph Based Methods2025.09 | 24.7 | 25.3 | 24.4 | 24.8 | |
| Self-RAGMethod Category=RAG & Based Methods, Model Scale=7B2025.09 | 23.8 | 19.9 | 22.4 | 22 | |
| CoT-PMC-LLaMAMethod Category=General & Medical LLMs with COT, Model Scale=7B, Chain-of-Thought=true2025.09 | 8.8 | 7.7 | 6.3 | 7.6 | |
| PMC-LLaMAMethod Category=General & Medical LLMs, Model Scale=7B2025.09 | 8.7 | 8.6 | 7.9 | 8.4 |