SugarCrepe
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SugarCrepe (test)
62.75Simple Accuracy
7
SugarCrepe (test)
96.9Replace Object
7
SugarCrepe
91.38Replace: Object Accuracy
6
SugarCrepe clean (external probe)
86.03Object Score
5
SugarCrepe
86.4Accuracy
5
SugarCrepe++
47.61SC++ Replace Avg
4
SugarCrepe
58.49SC Overall Score
4
Sugarcrepe swap-object
63.8Accuracy
4
SugarCREPE sampled balanced
58.7Accuracy
3
SugarCrepe Add Attribute
88.95GroupScore
2
SugarCrepe Swap Object
66.12GroupScore
2
SugarCrepe Swap Attribute
77.36GroupScore
2
SugarCrepe Replace Relation
76.23GroupScore
2
SugarCrepe
64.56Simple Accuracy
2