AXBENCH
Benchmarks
TaskDatasetSOTA resultTrendResults
AXBENCH (test)
1.102Overall Steering Score
28
AxBench (Held-in)
1.185HMean
25
AXBENCH
92.5Concept Score
22
AxBench
0.74Steering Score
18
AxBench Gemma-2-2B layer 20
0.871Steering Score
18
AxBench Gemma-2-9B layer 20
1.12Steering Score
17
AXBENCH D_L20^G9B
1.079Steering Score
12
AxBench full 500 concepts
96.5Mean AUROC
9
AXBENCH D_L10^G2B
0.803Steering Score
9
AXBENCH D_L32^Q32B
1.102Steering Score
7
AxBench (Held-out)
1.113HMean
6