SMAC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMAC (test)
100Win Rate (1c3s5z)
63
SMAC v2 (test)
84Win Rate (Protoss 5 Units)
35
SMAC
99.7Win Rate (3m)
34
SMAC II 1c3s5z (test)
2.1Exposure Intensity
24
SMAC MMM v2 (test)
3.03Exposure Intensity
24
SMAC II 8m v2 (test)
2.2Exposure Intensity
24
SMAC II 1c3s6z vs 1c3s5z v2 (test)
2.45Exposure Intensity
24
SMAC 1c3s5z II
18.87Adversary Reward
24
SMAC MMM II
19.16Adversary Reward
24
SMAC 8m II
17.07Adversary Reward
24
SMAC 1c3s6z vs 1c3s5z II
19.41Adversary Reward
24
SMAC 3m
99.9Win Rate
19
SMAC Avg. v1
1.006Normalized Win Rate
18
SMAC 6h* v1
104.9Normalized Win Rate
18
SMAC 3s5z v1
99.4Normalized Win Rate
18
SMAC 2s3z v1
100.2Normalized Win Rate
18
SMAC 3m v1
100.9Normalized Win Rate
18
SMAC maps
595m_vs_6m Score
18
SMAC 1o10b_vs_1r
65Win Rate
16
SMAC 5v5 full 3x5 grid v2
81Win Rate (Protoss)
15
SMAC terran_10v10 v2 (test)
36.4AUC
15
SMAC corridor v2
79.2Win Rate
15
SMAC 5m_vs_6m v2
53.9Win Rate
15
SMAC 3s5z vs 3s6z v2
0.801Win Rate
15
SMAC 3m to 8m
100Final Win Rate
13