SPURIOUS-MOTIF
Benchmarks
TaskDatasetSOTA resultTrendResults
Spurious-Motif → Spurious-Motif_bias Corr. Shift S→SB
55.6Accuracy
41
SPURIOUS-MOTIF b=0.9
0.895AUC
9
SPURIOUS-MOTIF b=0.7
0.898AUC
9
SPURIOUS-MOTIF b=0.5
90.55AUC
9
SPURIOUS-MOTIF b=0.9 (test)
61.49Accuracy
8
SPURIOUS-MOTIF b=0.7 (test)
67.31Accuracy
8
SPURIOUS-MOTIF b=0.5 (test)
69.72Accuracy
8
Spurious-Motif b=0.9 (test)
52Precision@5
4
Spurious-Motif b=0.7 (test)
51.2Precision@5
4
Spurious-Motif b=0.5 (test)
53.2Precision@5
4