SMAC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMAC Marines Expert
33.2Forward Transfer
7
SMAC 8mvs8m to 8mvs9m
96Final Win Rate
7
SMAC 3svs3z to 3svs5z
96Final Win Rate
7
SMAC 3svs3z to 3svs4z
0.95Final Win Rate
7
SMAC 8mvs8m to 8mvs9m
0.99Steps to 80% Reward
7
SMAC 3svs3z to 3svs5z
0.89Environment Steps to 80% Reward
7
SMAC 3svs3z to 3svs4z
0.62Environment Steps to 80% Reward
7
SMACLite 2s3z scenario (train)
100Win Rate
7
SMAC 2s3z
100Win Rate
7
SMAC v2
89Protoss 5v5 Win Rate
7
SMAC (StarCraft Multi-Agent Challenge) various scenarios
6Best Outcome
7
SMAC 1o_10b_vs_1r super_hard
73.44Win Rate
7
SMAC 1o_10b_vs_1r hard
75.77Win Rate
7
SMAC 1o_10b_vs_1r medium
79.79Win Rate
7
SMAC 1o_10b_vs_1r (easy)
81.88Win Rate
7
SMAC 1o_2r_vs_4r super_hard
63.28Win Rate
7
SMAC 1o_2r_vs_4r hard
68.81Win Rate
7
SMAC 1o_2r_vs_4r medium
79.72Win Rate
7
SMAC 1o_2r_vs_4r (easy)
81.25Win Rate
7
SMAC-Hard 2c_vs_64zg
0.974Win Rate
7
SMAC-Hard 10m_vs_11m
74.3Win Rate
7
SMAC-Hard 3s_vs_4z
97.8Win Rate
7
SMAC-Hard 2s_vs_1sc
94.8Win Rate
7
SMAC Hard 3s5z
0.872Win Rate
7
SMAC-Hard (3m)
100Win Rate
7