SMAC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMAC 2s_vs_1sc (Homog.)
96.1Win Rate
5
SMAC 2m_vs_1z (Homog.)
93.1Win Rate
5
SMAC corridor poor
5.61Average Return
5
SMAC corridor medium
11.66Average Return
5
SMAC corridor (good)
15.88Average Return
5
SMAC 6h_vs_8z (poor)
11.31Average Return
5
SMAC 6h_vs_8z medium
12.19Average Return
5
SMAC 6h_vs_8z (good)
12.54Average Return
5
SMAC 2c_vs_64zg (poor)
13.02Average Return
5
SMAC 2c_vs_64zg (medium)
16.03Average Return
5
SMAC 2c_vs_64zg good
19.15Average Return
5
SMAC 5m_vs_6m (poor)
7.61Average Return
5
SMAC 5m_vs_6m (medium)
7.92Average Return
5
SMAC 5m_vs_6m (good)
8.25Avg Return
5
SMAC corridor (medium-poor)
9.7Average Score
5
SMAC corridor (good-medium)
14.02Average Score
5
SMAC corridor (good-poor)
13.01Average Score
5
SMAC 6h_vs_8z (medium-poor)
11.85Average Score
5
SMAC 6h_vs_8z (good-medium)
12.05Average Score
5
SMAC 6h_vs_8z (good-poor)
11.88Average Score
5
SMAC 2m_vs_1z v1 (test)
100Win Rate
5
SMAC
93.8Win Rate
5
SMAC
100Win Rate
5
SMAC
100Win Rate
5
SMAC
100Win Rate
5