Multi-agent coordination on CollabCapture (test)
100Success RateGPT-4-Turbo
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-4-Turbo2026.06 | 100 | 3.5 | 49 | 3.8 | |
| MA-Debatemodel_size=235B2026.06 | 100 | 4.7 | 31 | 3.7 | |
| DICE-FTagents=3×8B2026.06 | 100 | 4.8 | 29 | 2.9 | |
| DICE-FTagents=3×32B2026.06 | 100 | 3.8 | 44 | 3.3 | |
| GPT-o32026.06 | 90 | 4.1 | 40 | 3.5 | |
| Qwen3-235B-Inst2026.06 | 90 | 6.2 | 9 | 3.6 | |
| MADagents=3×8B2026.06 | 90 | 6.8 | — | 3.1 | |
| MA-Debatemodel_size=32B2026.06 | 90 | 5.9 | 13 | 3.4 | |
| MA-FTmodel_size=32B2026.06 | 90 | 5.6 | 18 | 3.5 | |
| Debate+Judgebackbone=GPT-42026.06 | 90 | 5.3 | 22 | 4 | |
| DICE-PCagents=3×8B2026.06 | 90 | 5.2 | 24 | 3 | |
| Qwen3-32B-Inst2026.06 | 80 | 7.5 | 10 | 3.2 | |
| rStar2026.06 | 80 | 6.5 | 4 | 3.9 |