Classification on ColorMNIST (OOD)
73.8AccuracyERM
Evaluation Results
| Method | Links | |
|---|---|---|
| ERMshortcut severity (ρ)=0.52025.11 | 73.8 | |
| SITARshortcut severity (ρ)=0.92025.11 | 71.5 | |
| SITARshortcut severity (ρ)=1.02025.11 | 70.3 | |
| SITARshortcut severity (ρ)=0.72025.11 | 70.2 | |
| SITARshortcut severity (ρ)=0.52025.11 | 69.9 | |
| LfFshortcut severity (ρ)=0.92025.11 | 69.6 | |
| ERMshortcut severity (ρ)=0.72025.11 | 66.7 | |
| LfFshortcut severity (ρ)=0.72025.11 | 64.3 | |
| JTTshortcut severity (ρ)=0.92025.11 | 61.2 | |
| LfFshortcut severity (ρ)=0.52025.11 | 58.5 | |
| JTTshortcut severity (ρ)=0.52025.11 | 56.3 | |
| JTTshortcut severity (ρ)=0.72025.11 | 53.6 | |
| ERMshortcut severity (ρ)=0.92025.11 | 27.3 | |
| ERMshortcut severity (ρ)=1.02025.11 | 0 | |
| JTTshortcut severity (ρ)=1.02025.11 | 0 | |
| LfFshortcut severity (ρ)=1.02025.11 | 0 |