Multi-agent Question Answering on MedQA (first 300 questions)
44.55Average AccuracyTextFullT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TextFullTTraining Status=Training-Based, Communication Protocol=Text-Based, Number of Agents=3, Communication Turns=22026.05 | 44.55 | 44.67 | 505.03 | 5.47 | |
| AutoFormTraining Status=Training-Free, Communication Protocol=Text-Based, Number of Agents=3, Communication Turns=22026.05 | 44.11 | 46 | 1,717.6 | 18.18 | |
| NLTraining Status=Training-Free, Communication Protocol=Text-Based, Number of Agents=3, Communication Turns=22026.05 | 42.67 | 42.67 | 1,247.5 | 13.15 | |
| CipherTraining Status=Training-Free, Communication Protocol=Latent-Space, Number of Agents=3, Communication Turns=22026.05 | 42.56 | 43.33 | 1,137.89 | 11.58 | |
| LatentFullTTraining Status=Training-Based, Communication Protocol=Latent-Space, Number of Agents=3, Communication Turns=22026.05 | 42.11 | 42.33 | 57 | 0.7 | |
| HyLaTTraining Status=Training-Based, Communication Protocol=Latent-Space, Number of Agents=3, Communication Turns=22026.05 | 42.11 | 42.33 | 72.01 | 1.47 | |
| EcoLangTraining Status=Training-Free, Communication Protocol=Text-Based, Number of Agents=3, Communication Turns=22026.05 | 41.89 | 42.67 | 960.26 | 10.04 | |
| SDETraining Status=Training-Free, Communication Protocol=Text-Based, Number of Agents=3, Communication Turns=22026.05 | 40.78 | 41.67 | 1,316.2 | 14.48 | |
| Single-AgentTraining Status=Training-Free, Communication Protocol=Single-Agent, Number of Agents=1, Communication Turns=02026.05 | 38.33 | 38.33 | 113.59 | 1.25 | |
| LatentMAS-VTraining Status=Training-Free, Communication Protocol=Latent-Space, Number of Agents=3, Communication Turns=22026.05 | 32.67 | 33 | 324.43 | 3.61 |