Amazon Yelp
Benchmarks
TaskDatasetSOTA resultTrendResults
Amazon/Yelp Spurious 10% (test)
49.22F1 Score
9
Amazon Yelp Spurious 30% (test)
59.68F1 Score
9
Amazon Yelp Spurious 50% (test)
70.08F1 Score
9
Amazon Yelp Spurious 70% (test)
80.34F1 Score
9
Amazon Yelp Spurious 90% (test)
91.39F1 Score
9
Amazon/Yelp Spurious 90% (train)
99.99F1 Score
8
Amazon -> Yelp (test)
5.8ECE
6