MetaShift
Benchmarks
TaskDatasetSOTA resultTrendResults
MetaShift (test)
92.1Average Accuracy
60
MetaShift
93Average Accuracy
46
MetaShift
95.17Average Worst Group Accuracy
39
MetaShift Cat vs. Dog 18 (test)
92.4Test Accuracy
22
MetaShift Animals 8-class (test)
91.4Test Accuracy
22
MetaShift
91Precision@10
17
MetaShift Animals
91.4OOD Accuracy
13
MetaShift Cat vs. Dog
92.4Accuracy
13
MetaShift Animals
76.6Worst Case Accuracy
13
MetaShift Cat vs. Dog
88.8WGA
13
MetaShift (test)
79.4WGA
13
MetaShift (test)
83.2Worst Group Accuracy (WGA)
8
MetaShift 10-class
70.08Worst-group Acc (p=12%)
3
MetaShift 2-class
77.78Worst-group Accuracy (p=12%)
3