SMAC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMAC Zerg (5 agents) v2
49.1Win Rate
4
SMAC Protoss (10 agents) v2
56.3Win Rate
4
SMAC Terran (10 agents) v2
58.3Win Rate
4
SMAC Stalker-Zealot Medium-Replay quality
20.6Performance (2s3z)
4
SMAC Stalker-Zealot Medium-Expert quality
92.5Win Rate (2s3z)
4
SMAC Stalker-Zealot Medium quality
56.9Win Rate (2s3z)
4
SMAC Stalker-Zealot (Expert quality)
95.6Win Rate (2s3z)
4
SMAC Marine-Hard Medium-Replay
81.9Win Rate (3m)
4
SMAC Marine-Hard Medium
84.4Win Rate (3m)
4
SMAC Marine-Easy Unseen (test)
86.7Mean Win Rate
4
SMAC Marine-Hard Unseen (test)
57Mean Win Rate
4
SMAC Stalker-Zealot Seen (train)
63.4Mean Win Rate
4
SMAC Marine-Easy Seen (train)
91.2Mean Win Rate
4
SMAC Marine-Hard Seen (train)
79Mean Win Rate
4
SMAC Medium-replay v2
31.3Score (Terran, 3 units)
4
SMAC Medium v2
37.5Win Rate - Terran (3 Units)
4
SMAC v2 (overall)
30.3Total Mean Win Rate
4
SMAC v2 (seen)
31.3Terran Win Rate
4
SMAC 8m_vs_9m v1 (test)
40.05AUC
4
SMAC 6h vs 8z
95Win Rate
4
SMAC 25m
100Win Rate
4
SMAC 10m vs 11m
100Win Rate
4
SMAC 8m vs 9m
0.95Win Rate
4
SMAC 2s_vs_1sc (test)
1Test Win Rate
4
SMAC 5m → 10m → 20m → 30m → 40m
83.59Win Rate
3