Mathematical Reasoning on GSM8K (Acc, Uintra, Uinter, Usys)
0.796AccuracyUDPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UDPO# compromised agents=12026.02 | 0.796 | 0.112 | 0.084 | 0.125 | |
| UDPO# compromised agents=22026.02 | 0.689 | 0.172 | 0.138 | 0.198 | |
| RMAAC# compromised agents=12026.02 | 0.654 | 0.232 | 0.188 | 0.315 | |
| MAPPO# compromised agents=12026.02 | 0.627 | 0.303 | 0.202 | 0.338 | |
| UDPO# compromised agents=32026.02 | 0.562 | 0.258 | 0.212 | 0.288 | |
| Standard MAD# compromised agents=12026.02 | 0.549 | 0.286 | 0.255 | 0.522 | |
| RMAAC# compromised agents=22026.02 | 0.542 | 0.295 | 0.255 | 0.432 | |
| MAPPO# compromised agents=22026.02 | 0.506 | 0.318 | 0.275 | 0.468 | |
| Standard MAD# compromised agents=22026.02 | 0.418 | 0.412 | 0.408 | 0.548 | |
| RMAAC# compromised agents=32026.02 | 0.405 | 0.372 | 0.332 | 0.548 | |
| MAPPO# compromised agents=32026.02 | 0.367 | 0.402 | 0.355 | 0.592 | |
| Standard MAD# compromised agents=32026.02 | 0.094 | 0.662 | 0.525 | 0.614 |