Multi-Agent Reinforcement Learning on SMAC
99.7Win Rate (3m)WALL
Evaluation results
| Method | Links | ||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| WALLAttack Setting=Natural2025.02 | 99.7 | — | 99.3 | — | — | — | — | — | 99 | — | 99.4 | — | — | 99.8 | — | — | 99.5 | — | — | — | — | — | — | — | 99.4 | — | |
| MACPFTime steps=2M2026.05 | 99.4 | — | 97.6 | 93 | 44.5 | 39.3 | 27.1 | 81.7 | 98.8 | 88.9 | 98.5 | 96.8 | 6.1 | 98.2 | 63.2 | 16.3 | 97.9 | 99.2 | 37.4 | 1 | 99.2 | 98.1 | 98.8 | 94.5 | — | — | |
| Vanilla QMIXAttack Setting=Natural2025.02 | 99.2 | — | 97.6 | — | — | — | — | — | 99.2 | — | 98 | — | — | 99.2 | — | — | 99.1 | — | — | — | — | — | — | — | 98.7 | — | |
| ERNIEAttack Setting=Natural2025.02 | 99.2 | — | 99.8 | — | — | — | — | — | 98.5 | — | 98.2 | — | — | 99.8 | — | — | 99.2 | — | — | — | — | — | — | — | 99.1 | — | |
| RANDOMAttack Setting=Natural2025.02 | 99.1 | — | 99.2 | — | — | — | — | — | 99.6 | — | 99.7 | — | — | 99 | — | — | 99.3 | — | — | — | — | — | — | — | 99.3 | — | |
| MAPPOTime steps=2M2026.05 | 98.9 | — | 94.6 | 96.9 | 48.5 | 75.6 | 70.2 | 58.2 | 93.1 | 43.6 | 93.3 | 41.8 | 11 | 98.7 | 96.2 | 96.2 | 98.7 | 99.9 | 33 | 0.1 | 99.9 | 96.7 | 99.7 | 95.4 | — | — | |
| ATD+QMIXTime steps=2M2026.05 | 98.9 | — | 99.8 | 97.5 | 60.6 | 93.5 | 96.9 | 72.8 | 97.1 | 89.8 | 97.4 | 93 | 57 | 99 | 93.1 | 92.9 | 97.4 | 99.9 | 45.4 | 32.5 | 98.4 | 96.1 | 99.9 | 93.1 | — | — | |
| QPLEXTime steps=2M2026.05 | 98.8 | — | 97.1 | 53 | 45.5 | 63.5 | 64.5 | 10.5 | 97.4 | 26.3 | 97.4 | 93.4 | 7.4 | 99.2 | 36.8 | 32.7 | 95.5 | 98.6 | 0 | 0.8 | 99.1 | 95.3 | 99.7 | 82.3 | — | — | |
| QMIXTime steps=2M2026.05 | 98.1 | — | 92.9 | 87.2 | 55.1 | 91.9 | 92.1 | 51.2 | 96.6 | 38.2 | 94.8 | 86.3 | 1.5 | 97.2 | 89.2 | 38.3 | 97.4 | 98 | 25 | 11.9 | 98.2 | 92.6 | 97.6 | 92.2 | — | — | |
| OW-QMIXTime steps=2M2026.05 | 96 | — | 96.1 | 94.9 | 38.7 | 87.7 | 90.6 | 19.1 | 94.2 | 80.8 | 87.1 | 83.4 | 0.9 | 96.7 | 81.2 | 65.6 | 96.7 | 98.5 | 0 | 0.6 | 93.2 | 92.5 | 99.4 | 90.1 | — | — | |
| RAPAttack Setting=Natural2025.02 | 95.8 | — | 94.7 | — | — | — | — | — | 95.5 | — | 98.8 | — | — | 99.5 | — | — | 84.2 | — | — | — | — | — | — | — | 94.7 | — | |
| RARLAttack Setting=Natural2025.02 | 93.8 | — | 95.5 | — | — | — | — | — | 90.6 | — | 97.8 | — | — | 93.1 | — | — | 84 | — | — | — | — | — | — | — | 92.5 | — | |
| ROMANCEAttack Setting=Natural2025.02 | 93.6 | — | 99.6 | — | — | — | — | — | 96.4 | — | 96.4 | — | — | 99.7 | — | — | 96.5 | — | — | — | — | — | — | — | 97 | — | |
| WALLAttack Setting=Wolfpack Adversarial Attack2025.02 | 90.8 | — | 83.6 | — | — | — | — | — | 95 | — | 92.2 | — | — | 99.8 | — | — | 98.8 | — | — | — | — | — | — | — | 93.4 | — | |
| WALLAttack Setting=Random Attack2025.02 | 87.4 | — | 95.8 | — | — | — | — | — | 99.4 | — | 94.6 | — | — | 99.8 | — | — | 98.6 | — | — | — | — | — | — | — | 95.9 | — | |
| WALLAttack Setting=EGA2025.02 | 87 | — | 95.8 | — | — | — | — | — | 94.2 | — | 88.6 | — | — | 98.7 | — | — | 97 | — | — | — | — | — | — | — | 93.6 | — | |
| ROMANCEAttack Setting=EGA2025.02 | 85.8 | — | 90.9 | — | — | — | — | — | 87.8 | — | 79.8 | — | — | 91 | — | — | 89.6 | — | — | — | — | — | — | — | 87.5 | — | |
| RAPAttack Setting=EGA2025.02 | 84.4 | — | 86.2 | — | — | — | — | — | 83.9 | — | 70.4 | — | — | 83.8 | — | — | 80.2 | — | — | — | — | — | — | — | 81.5 | — | |
| RANDOMAttack Setting=Random Attack2025.02 | 76.4 | — | 80.2 | — | — | — | — | — | 95.4 | — | 90.8 | — | — | 97.4 | — | — | 96 | — | — | — | — | — | — | — | 89.4 | — | |
| RARLAttack Setting=EGA2025.02 | 74.4 | — | 78.4 | — | — | — | — | — | 83.4 | — | 62.6 | — | — | 88.4 | — | — | 80.1 | — | — | — | — | — | — | — | 77.9 | — | |
| ROMANCEAttack Setting=Random Attack2025.02 | 71.6 | — | 84.8 | — | — | — | — | — | 86.8 | — | 90.2 | — | — | 99.6 | — | — | 94 | — | — | — | — | — | — | — | 87.8 | — | |
| RANDOMAttack Setting=EGA2025.02 | 70.6 | — | 87.5 | — | — | — | — | — | 84.4 | — | 65.3 | — | — | 68.8 | — | — | 84.5 | — | — | — | — | — | — | — | 76.9 | — | |
| Vanilla QMIXAttack Setting=Random Attack2025.02 | 69.6 | — | 69 | — | — | — | — | — | 66.4 | — | 80.4 | — | — | 91.4 | — | — | 94.8 | — | — | — | — | — | — | — | 78.6 | — | |
| RAPAttack Setting=Random Attack2025.02 | 69.2 | — | 85 | — | — | — | — | — | 86.7 | — | 91 | — | — | 97.8 | — | — | 86.6 | — | — | — | — | — | — | — | 83 | — | |
| Vanilla QMIXAttack Setting=EGA2025.02 | 66.5 | — | 71.2 | — | — | — | — | — | 70.6 | — | 54 | — | — | 72.4 | — | — | 83 | — | — | — | — | — | — | — | 69.6 | — | |
| ERNIEAttack Setting=Random Attack2025.02 | 65.2 | — | 76.2 | — | — | — | — | — | 86 | — | 83.2 | — | — | 90.2 | — | — | 95.6 | — | — | — | — | — | — | — | 82.7 | — | |
| ERNIEAttack Setting=EGA2025.02 | 60.4 | — | 81.6 | — | — | — | — | — | 85 | — | 52.4 | — | — | 83.2 | — | — | 93.6 | — | — | — | — | — | — | — | 76 | — | |
| RARLAttack Setting=Random Attack2025.02 | 58.7 | — | 70.2 | — | — | — | — | — | 84.2 | — | 86.8 | — | — | 89.2 | — | — | 79.1 | — | — | — | — | — | — | — | 78 | — | |
| RANDOMAttack Setting=Wolfpack Adversarial Attack2025.02 | 57.4 | — | 40.4 | — | — | — | — | — | 63.6 | — | 60.4 | — | — | 91 | — | — | 68.4 | — | — | — | — | — | — | — | 63.5 | — | |
| RAPAttack Setting=Wolfpack Adversarial Attack2025.02 | 37.5 | — | 35.6 | — | — | — | — | — | 47 | — | 60 | — | — | 95.4 | — | — | 75.7 | — | — | — | — | — | — | — | 58.5 | — | |
| ERNIEAttack Setting=Wolfpack Adversarial Attack2025.02 | 35.4 | — | 26.4 | — | — | — | — | — | 26.2 | — | 43.2 | — | — | 94.8 | — | — | 77 | — | — | — | — | — | — | — | 50.5 | — | |
| ROMANCEAttack Setting=Wolfpack Adversarial Attack2025.02 | 34.8 | — | 28.6 | — | — | — | — | — | 48.8 | — | 62.4 | — | — | 98.6 | — | — | 81.2 | — | — | — | — | — | — | — | 59.1 | — | |
| RARLAttack Setting=Wolfpack Adversarial Attack2025.02 | 31.1 | — | 14.2 | — | — | — | — | — | 51.1 | — | 52.4 | — | — | 90 | — | — | 75.9 | — | — | — | — | — | — | — | 52.5 | — | |
| Vanilla QMIXAttack Setting=Wolfpack Adversarial Attack2025.02 | 31 | — | 11.4 | — | — | — | — | — | 10.4 | — | 39.8 | — | — | 84.4 | — | — | 59.2 | — | — | — | — | — | — | — | 39.4 | — | |
| AdaPS2025.12 | — | 0.614 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CW-QMIX2024.05 | — | — | — | — | — | — | — | — | — | 92 | — | — | — | — | — | 99 | — | — | 79 | — | — | — | — | — | — | — | |
| FPS2025.12 | — | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FPS+id2025.12 | — | 0.992 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HetDPS2025.12 | — | 0.712 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Kaleidoscope2025.12 | — | 0.974 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MACPO2026.06 | — | — | — | — | — | — | — | — | — | 90.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.9 | |
| MADAC2026.06 | — | — | — | — | — | — | — | — | — | 90.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 78.4 | |
| MADDPG2026.06 | — | — | — | — | — | — | — | — | — | 69.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.4 | |
| MADPS2025.12 | — | 0.539 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MAPPO2026.06 | — | — | — | — | — | — | — | — | — | 91.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 83.9 | |
| MAPPO-Lag2026.06 | — | — | — | — | — | — | — | — | — | 89.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 80.2 | |
| NPS2025.12 | — | 0.952 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| OW-QMIX2024.05 | — | — | — | — | — | — | — | — | — | 98 | — | — | — | — | — | 100 | — | — | 70 | — | — | — | — | — | — | — | |
| POW-QMIX2024.05 | — | — | — | — | — | — | — | — | — | 98 | — | — | — | — | — | 100 | — | — | 95 | — | — | — | — | — | — | — | |
| POW-QPLEX2024.05 | — | — | — | — | — | — | — | — | — | 93 | — | — | — | — | — | 100 | — | — | 94 | — | — | — | — | — | — | — | |
| POW-VDN2024.05 | — | — | — | — | — | — | — | — | — | 90 | — | — | — | — | — | 96 | — | — | 87 | — | — | — | — | — | — | — | |
| QMIX2024.05 | — | — | — | — | — | — | — | — | — | 98 | — | — | — | — | — | 100 | — | — | 69 | — | — | — | — | — | — | — | |
| QPLEX2024.05 | — | — | — | — | — | — | — | — | — | 0 | — | — | — | — | — | 96 | — | — | 30 | — | — | — | — | — | — | — | |
| ResQ2024.05 | — | — | — | — | — | — | — | — | — | 90 | — | — | — | — | — | 100 | — | — | 0 | — | — | — | — | — | — | — | |
| SePS2025.12 | — | 0.986 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TRIDENT2026.06 | — | — | — | — | — | — | — | — | — | 93.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 86.3 | |
| VDN2024.05 | — | — | — | — | — | — | — | — | — | 81 | — | — | — | — | — | 97 | — | — | 87 | — | — | — | — | — | — | — |