Task-Oriented Multi-Agent Communication on MMLU, ARC-C, GSM8K, OpenBookQA, MedQA Average (test)
79.03AccuracyTodyComm
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TodyCommAttack rate=< 50%2026.02 | 79.03 | 409.2 | |
| TodyCommAttack rate== 50%2026.02 | 77.45 | 422.2 | |
| Agent PruneAttack rate=< 50%2026.02 | 77.04 | 383 | |
| GDesignerAttack rate=< 50%2026.02 | 75.17 | 607.8 | |
| TodyCommAttack rate=> 50%2026.02 | 73.39 | 430.2 | |
| Complete GraphAttack rate=< 50%2026.02 | 70.92 | 758.8 | |
| Random GraphAttack rate=< 50%2026.02 | 68.95 | 606.2 | |
| Agent PruneAttack rate== 50%2026.02 | 60.52 | 444 | |
| GDesignerAttack rate== 50%2026.02 | 59.05 | 643.4 | |
| Agent PruneAttack rate=> 50%2026.02 | 55.78 | 458.2 | |
| Random GraphAttack rate== 50%2026.02 | 55.38 | 635.4 | |
| Complete GraphAttack rate== 50%2026.02 | 55.19 | 773 | |
| GDesignerAttack rate=> 50%2026.02 | 54.07 | 636.2 | |
| Random GraphAttack rate=> 50%2026.02 | 50.7 | 625 | |
| Complete GraphAttack rate=> 50%2026.02 | 50.23 | 756.6 |