SMAC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMAC 5gen_protoss task-switch v2
91.17Win Rate
3
SMAC 5gen_protoss v2
60.89Win Rate
3
SMACLite 3s5z scenario Zero-shot
49.7Win Rate
3
SMAC complete benchmark 10 seeds
78Win Rate (2s_vs_1sc)
3
SMAC 3s_vs_5z
71Win Rate
3
SMAC 2s_vs_1sc
78Win Rate
3
SMAC 9m_vs_11m unseen (test)
76.44Win Rate
3
SMAC 3s5z_vs_3s7z (test)
22.08Win Rate
3
SMAC 3s4z unseen (test)
90.21Win Rate
3
SMAC 6m_vs_7m unseen (test)
81.07Win Rate
3
SMAC 1c2s7z unseen (test)
28.26Win Rate
3
SMAC 1c3s6z (unseen test)
65.38Win Rate
3
SMAC 3s2z_vs_2s3z unseen (test)
18.22Win Rate
3
SMAC 1c_vs_32zg unseen (test)
58.33Win Rate
3
SMAC 6m unseen (test)
97.85Win Rate
3
SMAC 1c3s unseen (test)
56.47Win Rate
3
SMAC 2s3z
7,371.785Hypervolume
2
SMAC 3s_v_3z
94.8Stage-1 Accuracy
2
SMAC 2c_vs_64zg (train)
—Primary metric
0
SMAC 2m_vs_1z (train)
—Primary metric
0