Medical Question Answering on DDXPlus
86.5AccuracyMulti-Agent Medical Decision Consensus Matrix System
Evaluation results
| Method | Links | |
|---|---|---|
| Multi-Agent Medical Decision Consensus Matrix System2025.12 | 86.5 | |
| MAPLESize=8B, Inference Protocol=BoM2026.03 | 83 | |
| ST-EVOBackbone=gpt-oss-120b2026.02 | 82.5 | |
| TeamMedAgents2025.12 | 82.4 | |
| MDAgents2025.12 | 81.2 | |
| Weighted VotingMulti-Agent Aggregation Method=Weighted Voting2025.12 | 80.3 | |
| R1-Distill-LlamaSize=8B, Inference Protocol=MV2026.03 | 80 | |
| Majority VotingMulti-Agent Aggregation Method=Majority Voting2025.12 | 79.5 | |
| Med-PRMSize=8B, Inference Protocol=BoM2026.03 | 79 | |
| Borda CountMulti-Agent Aggregation Method=Borda Count2025.12 | 78.9 | |
| Chain-of-ThoughtPrompting Strategy=Chain-of-Thought2025.12 | 78.2 | |
| Med-PRMSize=8B, Inference Protocol=SC + RM2026.03 | 78 | |
| SafeSieveBackbone=gpt-oss-120b2026.02 | 77.94 | |
| Single-AgentEvaluation Protocol=Few-shot2025.12 | 76.8 | |
| SpecReasonBackbone=gpt-oss-120b2026.02 | 76.58 | |
| G-DesignerBackbone=gpt-oss-120b2026.02 | 76.42 | |
| ARG-DesignerBackbone=gpt-oss-120b2026.02 | 76.03 | |
| GPTSwarmBackbone=gpt-oss-120b2026.02 | 75.57 | |
| STEERBackbone=gpt-oss-120b2026.02 | 75.2 | |
| AFlowBackbone=gpt-oss-120b2026.02 | 74.25 | |
| Single-AgentEvaluation Protocol=Zero-shot2025.12 | 74.1 | |
| Llama3.1Size=8B, Inference Protocol=MV2026.03 | 74 | |
| LangGraphBackbone=gpt-oss-120b2026.02 | 72.5 | |
| UltraMedicalSize=8B, Inference Protocol=MV2026.03 | 72 | |
| AutoGenBackbone=gpt-oss-120b2026.02 | 71.83 | |
| LLM-DebateBackbone=gpt-oss-120b2026.02 | 71.33 | |
| Random GraphBackbone=gpt-oss-120b2026.02 | 70.44 | |
| Complete GraphBackbone=gpt-oss-120b2026.02 | 70.35 | |
| TreeBackbone=gpt-oss-120b2026.02 | 69.25 | |
| Gemma 2Size=9B, Inference Protocol=MV2026.03 | 69 | |
| StarBackbone=gpt-oss-120b2026.02 | 68.25 | |
| SCBackbone=gpt-oss-120b2026.02 | 66.43 | |
| Llama3.1Size=8B, Inference Protocol=pass@12026.03 | 66.41 | |
| ChainBackbone=gpt-oss-120b2026.02 | 65.28 | |
| CoTBackbone=gpt-oss-120b2026.02 | 64.22 | |
| Gemma 2Size=9B, Inference Protocol=pass@12026.03 | 63.8 | |
| UltraMedicalSize=8B, Inference Protocol=pass@12026.03 | 63.59 | |
| R1-Distill-QwenSize=7B, Inference Protocol=MV2026.03 | 62 | |
| HuatuoGPT-o1Size=8B, Inference Protocol=pass@12026.03 | 58.33 | |
| HuatuoGPT-o1Size=8B, Inference Protocol=MV2026.03 | 58.33 | |
| VanillaBackbone=gpt-oss-120b2026.02 | 56.4 | |
| R1-Distill-LlamaSize=8B, Inference Protocol=pass@12026.03 | 49.22 | |
| R1-Distill-QwenSize=7B, Inference Protocol=pass@12026.03 | 28.9 |