SMAC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMAC
100Win Rate
5
SMAC
100Win Rate
5
SMAC
100Win Rate
5
SMAC 3s5z vs 3s6z v1 (train)
96.5Win Rate
5
SMAC 6h vs 8z v1 (train)
98.8Win Rate
5
SMAC MMM2 v1 (train)
93.8Win Rate
5
SMAC 27m vs 30m v1 (train)
1Win Rate
5
SMAC 10m vs 11m v1 (train)
100Win Rate
5
SMAC 8m vs 9m v1 (train)
1Win Rate
5
SMAC 3s5z v1 (train)
100Win Rate
5
SMAC 3s vs 5z v1 (train)
1Win Rate
5
SMAC 2c vs 64zg v1 (train)
1Win Rate
5
SMAC MMM v1 (train)
1Win Rate
5
SMAC 1c3s5z v1 (train)
100Win Rate
5
SMAC bane_vs_bane (test)
99Test Win Rate
5
SMAC 10m_vs_11m (test)
97Test Win Rate
5
SMAC 2s3z (test)
99Win Rate
5
SMAC-8m
87Success Rate
4
SMAC 3m
97Success Rate
4
SMAC 27m_vs_30m
0.19Perturbation Magnitude (L-inf)
4
SMAC bane_vs_bane
0.16Perturbation Magnitude (L-inf)
4
SMAC 8m
0.12Perturbation Magnitude (L-inf)
4
SMAC unseen tasks v2
67Win Rate (Protoss 5v5)
4
SMAC unseen tasks
78Win Rate (3s vs 3z)
4
SMAC 3s5z map (heterogeneous setup)
61.56Win Rate (%)
4