Multi-choice Medical Question Answering on Medical QA Multi-choice
70.7MMLU-Med AccuracyMedLA + LLaMA3.1(8B)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MedLA + LLaMA3.1(8B)Method Category=Logic Based, Backbone=LLaMA3.1(8B)2025.09 | 70.7 | 62.6 | 76.5 | 69.9 | |
| LLaMA3.1Method Category=General & Medical LLMs with COT, Chain of Thought (CoT)=true, Model Size=8B2025.09 | 68.1 | 54.9 | 70.6 | 64.5 | |
| LLaMA3.1 [baseline]Method Category=General & Medical LLMs, Model Size=8B2025.09 | 67.7 | 56.3 | 68.7 | 64.2 | |
| LLaMA3Method Category=General & Medical LLMs with COT, Chain of Thought (CoT)=true, Model Size=8B2025.09 | 65.1 | 55.2 | 64.2 | 61.5 | |
| MDAgentsMethod Category=Multi Agents2025.09 | 65 | 53.4 | 64 | 60.8 | |
| MedAgentsMethod Category=Multi Agents2025.09 | 64.3 | 53.2 | 64.1 | 60.5 | |
| MistralMethod Category=General & Medical LLMs, Model Size=7B2025.09 | 63.4 | 47.7 | 64.4 | 58.5 | |
| LLaMA3Method Category=General & Medical LLMs, Model Size=8B2025.09 | 63.4 | 56.6 | 65.4 | 61.8 | |
| MistralMethod Category=General & Medical LLMs with COT, Chain of Thought (CoT)=true, Model Size=7B2025.09 | 63.4 | 47.4 | 65.1 | 58.6 | |
| DyLANMethod Category=Multi Agents2025.09 | 62.5 | 51.6 | 63.8 | 59.3 | |
| MedAlpacaMethod Category=General & Medical LLMs with COT, Chain of Thought (CoT)=true, Model Size=7B2025.09 | 60.3 | 39.9 | 48.5 | 49.6 | |
| MV-LLaMA3.1Method Category=Multi Agents, Model Size=8B2025.09 | 60.2 | 46.8 | 65.2 | 57.4 | |
| MedAlpacaMethod Category=General & Medical LLMs, Model Size=7B2025.09 | 60 | 40.1 | 49.3 | 49.8 | |
| MedRAGMethod Category=RAG Based, Model Size=70B2025.09 | 57.9 | 48.7 | 71.9 | 59.5 | |
| Self-RAGMethod Category=RAG Based, Model Size=13B2025.09 | 50.2 | 40.8 | 64.6 | 51.9 | |
| KG-RankMethod Category=RAG Based, Model Size=13B2025.09 | 45.2 | 36.2 | 50.3 | 43.9 | |
| Self-RAGMethod Category=RAG Based, Model Size=7B2025.09 | 32.2 | 38 | 59.4 | 43.2 | |
| DragonMethod Category=Graph Based2025.09 | 31.9 | 47.5 | 70.6 | 50 | |
| QAGNNMethod Category=Graph Based2025.09 | 31.7 | 47 | 70.7 | 49.8 | |
| JointLKMethod Category=Graph Based2025.09 | 28.8 | 42.5 | 70.6 | 47.3 | |
| PMC-LLaMAMethod Category=General & Medical LLMs, Model Size=7B2025.09 | 20.7 | 24.7 | 34.6 | 26.7 | |
| PMC-LLaMAMethod Category=General & Medical LLMs with COT, Chain of Thought (CoT)=true, Model Size=7B2025.09 | 20.4 | 20.8 | 20.8 | 20.7 |