3s5z vs 3s6z on SMAC
96.5Win RateMAT
Evaluation results
| Method | Links | |
|---|---|---|
| MATDifficulty=Hard+, Steps=2e72022.05 | 96.5 | |
| GPAESampling Protocol=off-policy, Timesteps=1 x 10^7, Random Seeds=52026.03 | 87.3 | |
| MAT-DecDifficulty=Hard+, Steps=2e72022.05 | 85.3 | |
| MAPPODifficulty=Hard+, Steps=2e72022.05 | 84.3 | |
| HAPPODifficulty=Hard+, Steps=2e72022.05 | 82.8 | |
| QMIXDifficulty=Hard+, Steps=2e72022.05 | 68.8 | |
| DAETimesteps=1 x 10^7, Random Seeds=52026.03 | 6.5 | |
| GPAESampling Protocol=on-policy, Timesteps=1 x 10^7, Random Seeds=52026.03 | 6.1 | |
| MAPPOTimesteps=1 x 10^7, Random Seeds=52026.03 | 2.6 | |
| QMIXTimesteps=1 x 10^7, Random Seeds=52026.03 | 1.3 | |
| VDNTimesteps=1 x 10^7, Random Seeds=52026.03 | 0.5 | |
| COMATimesteps=1 x 10^7, Random Seeds=52026.03 | 0 |