Spurious Correlation Discovery on MNIST, FashionMNIST, and COCO 654 evaluation settings (test)
91.1mP@10RAVL
Evaluation Results
| Method | Links | |
|---|---|---|
| RAVLCorrelation Strength (τ_eval)=40, Num. Eval Settings=1682024.11 | 91.1 | |
| RAVLCorrelation Strength (τ_eval)=30, Num. Eval Settings=2342024.11 | 84.2 | |
| RAVLCorrelation Strength (τ_eval)=20, Num. Eval Settings=3692024.11 | 76.2 | |
| RAVLCorrelation Strength (τ_eval)=10, Num. Eval Settings=6542024.11 | 61.8 | |
| Spurious-Aware DetectionCorrelation Strength (τ_eval)=40, Num. Eval Settings=1682024.11 | 42 | |
| Spurious-Aware DetectionCorrelation Strength (τ_eval)=30, Num. Eval Settings=2342024.11 | 32.1 | |
| Spurious-Aware DetectionCorrelation Strength (τ_eval)=20, Num. Eval Settings=3692024.11 | 25.3 | |
| RandomCorrelation Strength (τ_eval)=10, Num. Eval Settings=6542024.11 | 21.2 | |
| Distilling FailuresCorrelation Strength (τ_eval)=10, Num. Eval Settings=6542024.11 | 20.1 | |
| Spurious-Aware DetectionCorrelation Strength (τ_eval)=10, Num. Eval Settings=6542024.11 | 20 | |
| GeorgeCorrelation Strength (τ_eval)=10, Num. Eval Settings=6542024.11 | 19.3 | |
| RandomCorrelation Strength (τ_eval)=20, Num. Eval Settings=3692024.11 | 18.2 | |
| DominoCorrelation Strength (τ_eval)=10, Num. Eval Settings=6542024.11 | 17.1 | |
| Distilling FailuresCorrelation Strength (τ_eval)=20, Num. Eval Settings=3692024.11 | 16.2 | |
| GeorgeCorrelation Strength (τ_eval)=20, Num. Eval Settings=3692024.11 | 15.9 | |
| RandomCorrelation Strength (τ_eval)=30, Num. Eval Settings=2342024.11 | 15.5 | |
| DominoCorrelation Strength (τ_eval)=20, Num. Eval Settings=3692024.11 | 15 | |
| RandomCorrelation Strength (τ_eval)=40, Num. Eval Settings=1682024.11 | 12.5 | |
| DominoCorrelation Strength (τ_eval)=30, Num. Eval Settings=2342024.11 | 11.7 | |
| GeorgeCorrelation Strength (τ_eval)=30, Num. Eval Settings=2342024.11 | 10.9 | |
| DominoCorrelation Strength (τ_eval)=40, Num. Eval Settings=1682024.11 | 9 | |
| Distilling FailuresCorrelation Strength (τ_eval)=30, Num. Eval Settings=2342024.11 | 8.5 | |
| GeorgeCorrelation Strength (τ_eval)=40, Num. Eval Settings=1682024.11 | 7.7 | |
| Distilling FailuresCorrelation Strength (τ_eval)=40, Num. Eval Settings=1682024.11 | 1.5 |