Medical Reasoning on Professional Medicine
74.6AccuracyMajority Vote
Evaluation Results
| Method | Links | |
|---|---|---|
| Majority VoteModel=Llama3.1-8B2026.03 | 74.6 | |
| Vote PromptBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 73.2 | |
| Society Of MindBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 73 | |
| MAD-M^2Backbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 73 | |
| MAD-M2Model=Falcon3-7B2026.03 | 72.8 | |
| DARModel=Falcon3-7B2026.03 | 72.8 | |
| Vote PromptModel=Falcon3-7B2026.03 | 72.7 | |
| DARBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 72.7 | |
| Uncertain PromptModel=Falcon3-7B2026.03 | 72.3 | |
| Uncertain PromptBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 72.3 | |
| DARModel=Llama3.1-8B2026.03 | 72.2 | |
| Majority VoteBackbone Model=Falcon3-7B, Number of Agents=4, Number of Rounds=22026.03 | 72.1 | |
| Society Of MindModel=Falcon3-7B2026.03 | 71.9 | |
| DARBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 71.2 | |
| Uncertain PromptModel=Llama3.1-8B2026.03 | 70.6 | |
| Single-agentModel=Falcon3-7B2026.03 | 70.3 | |
| Single-agentBackbone Model=Falcon3-7B2026.03 | 70.3 | |
| Majority VoteBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 70 | |
| Majority VoteModel=Falcon3-7B2026.03 | 68.7 | |
| Vote PromptModel=Llama3.1-8B2026.03 | 67.9 | |
| Uncertain PromptBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 67.9 | |
| MAD-M^2Backbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 66.7 | |
| Society Of MindBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 66.5 | |
| Single-agentModel=Llama3.1-8B2026.03 | 66.3 | |
| Single-agentBackbone Model=Llama3.1-8B2026.03 | 66.3 | |
| MAD-M2Model=Llama3.1-8B2026.03 | 66.1 | |
| Vote PromptBackbone Model=Llama3.1-8B, Number of Agents=4, Number of Rounds=22026.03 | 65.8 | |
| DARModel=Qwen2.5-3B2026.03 | 65.6 | |
| Uncertain PromptBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 65.6 | |
| DARBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 65.1 | |
| MAD-M2Model=Qwen2.5-3B2026.03 | 64.8 | |
| Vote PromptModel=Qwen2.5-3B2026.03 | 64.8 | |
| MAD-M^2Backbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 64.7 | |
| Society Of MindModel=Qwen2.5-3B2026.03 | 64.5 | |
| Uncertain PromptModel=Qwen2.5-3B2026.03 | 64.1 | |
| Society Of MindBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 63.8 | |
| Majority VoteModel=Qwen2.5-3B2026.03 | 63.7 | |
| Majority VoteBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 63.6 | |
| Vote PromptBackbone Model=Qwen2.5-3B, Number of Agents=4, Number of Rounds=22026.03 | 62.7 | |
| Society Of MindModel=Llama3.1-8B2026.03 | 61.8 | |
| Single-agentBackbone Model=Qwen2.5-3B2026.03 | 59.8 | |
| Single-agentModel=Qwen2.5-3B2026.03 | 58.8 | |
| DARBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 58.7 | |
| Majority VoteModel=Qwen2.5-1.5B2026.03 | 58.6 | |
| Majority VoteBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 58.6 | |
| Vote PromptBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 58.6 | |
| Vote PromptModel=Qwen2.5-1.5B2026.03 | 57.7 | |
| Society Of MindBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 57.7 | |
| Uncertain PromptBackbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 57.7 | |
| Society Of MindModel=Qwen2.5-1.5B2026.03 | 57.6 | |
| Uncertain PromptModel=Qwen2.5-1.5B2026.03 | 57.6 | |
| MAD-M2Model=Qwen2.5-1.5B2026.03 | 57.5 | |
| MAD-M^2Backbone Model=Qwen2.5-1.5B, Number of Agents=4, Number of Rounds=22026.03 | 57.4 | |
| Single-agentModel=Qwen2.5-1.5B2026.03 | 55.6 | |
| Single-agentBackbone Model=Qwen2.5-1.5B2026.03 | 55.6 | |
| DARModel=Qwen2.5-1.5B2026.03 | 51.1 |