Medical Question Answering on MedQA (Accuracy, F1, Avg. Accuracy)
0.843AccuracyMediHive
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MediHiveAgent Configuration=Multi-Agent2026.03 | 0.843 | 0.825 | 0.814 | |
| MedAgentsAgent Configuration=Multi-Agent2026.03 | 0.837 | 0.821 | 0.803 | |
| Multiagent DebateAgent Configuration=Multi-Agent2026.03 | 0.804 | 0.783 | 0.793 | |
| Centralized Multi-Agent SystemAgent Configuration=Multi-Agent2026.03 | 0.778 | 0.761 | 0.766 | |
| Few-shot w/ CoTAgent Configuration=Single-Agent, Prompting Setting=Few-shot, Reasoning Strategy=CoT2026.03 | 0.746 | 0.731 | 0.735 | |
| Few-shot w/ CoT + SCAgent Configuration=Single-Agent, Prompting Setting=Few-shot, Reasoning Strategy=CoT + SC2026.03 | 0.744 | 0.729 | 0.741 | |
| Zero-shot w/ CoT + SCAgent Configuration=Single-Agent, Prompting Setting=Zero-shot, Reasoning Strategy=CoT + SC2026.03 | 0.738 | 0.709 | 0.73 | |
| Zero-shot w/ CoTAgent Configuration=Single-Agent, Prompting Setting=Zero-shot, Reasoning Strategy=CoT2026.03 | 0.732 | 0.705 | 0.72 | |
| Few-shotAgent Configuration=Single-Agent, Prompting Setting=Few-shot2026.03 | 0.728 | 0.71 | 0.722 | |
| Zero-shotAgent Configuration=Single-Agent, Prompting Setting=Zero-shot2026.03 | 0.715 | 0.668 | 0.704 |