Multi-agent coordination on Overcooked-AI Mean of CR/AA/Ring/FC/CC layouts
182.7Self-Play ScoreGPT-4-Turbo
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4-Turbo2026.06 | 182.7 | 144 | 21.2 | 4.3 | 24.9 | 8.1 | 0.28 | 3.7 | 4.1 | |
| GPT-o32026.06 | 156.3 | 127.8 | 18.2 | 5.2 | 21.7 | 9.8 | 0.31 | 3.5 | 3.8 | |
| Debate+Judge (GPT-4)2026.06 | 125.7 | 119.3 | 5.1 | 5.8 | 18.9 | 11.4 | 0.33 | 3.6 | 5.2 | |
| DICE-FTSize=3×32B2026.06 | 121.6 | 122.1 | 0.4 | 6.2 | 20.7 | 11.8 | 0.26 | 2.9 | 3.7 | |
| MA-Debate (235B)Size=3×235B2026.06 | 117.4 | 118.6 | 1 | 6.3 | 19.8 | 12.1 | 0.29 | 3.4 | 5.1 | |
| DICE-FTSize=3×8B2026.06 | 114.4 | 114.9 | 0.5 | 6.9 | 18.9 | 13.2 | 0.29 | 2.7 | 3.6 | |
| rStarSize=3×32B2026.06 | 112.3 | 106.8 | 4.9 | 6.9 | 17.8 | 13.7 | 0.35 | 3.3 | 5.8 | |
| DICE-PCSize=3×8B2026.06 | 110.4 | 110.6 | 0.2 | 7.5 | 17.8 | 14.1 | 0.32 | 2.8 | 3.9 | |
| MA-FT (32B)Size=3×32B2026.06 | 109.7 | 110.4 | 0.6 | 7.2 | 17.1 | 14.5 | 0.33 | 3 | 4.2 | |
| Qwen3-235B-InstSize=1×235B2026.06 | 108.2 | 96.4 | 10.9 | 7.1 | 15.8 | 14.7 | 0.39 | 3.1 | 3.4 | |
| MA-Debate (32B)Size=3×32B2026.06 | 106.8 | 109.2 | 2.2 | 7.8 | 16.3 | 15.2 | 0.36 | 3.2 | 4.7 | |
| CAC (learned)Size=3×8B2026.06 | 105.2 | 108.9 | 3.5 | 8 | 15.8 | 16.2 | 0.38 | 3 | 4.6 | |
| CAC (uniform)Size=3×8B2026.06 | 103.7 | 107.1 | 3.3 | 8.3 | 15.2 | 16.8 | 0.4 | 2.9 | 4.4 | |
| MADSize=3×8B2026.06 | 101.3 | 108.5 | 7.1 | 8.6 | 14.7 | 17.6 | 0.42 | 2.9 | 4.5 | |
| Role-PlaySize=3×8B2026.06 | 98.4 | 104.2 | 5.9 | 9.1 | 13.9 | 18.9 | 0.44 | 2.8 | 4.3 | |
| Qwen3-32B-InstSize=1×32B2026.06 | 95.7 | 88.3 | 7.7 | 8.9 | 12.4 | 18.3 | 0.47 | 2.8 | 3.2 |