Failure Prediction on ImageNet-LT (test)
67.2AUC (All)TLC
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TLCNumber of experts=42021.11 | 67.2 | 76.2 | 68.7 | 49.4 | 82.6 | 65.2 | 81.5 | 94.3 | 31.9 | 23.8 | 30.8 | 40.1 | |
| LDAM-DRW2021.11 | 66.8 | 76.8 | 67.5 | 47.6 | 82.8 | 70.9 | 81.7 | 96.1 | 35.1 | 28.6 | 40.7 | 50.4 | |
| TLCNumber of experts=22021.11 | 66.7 | 75.2 | 71.2 | 48.2 | 84.5 | 65.9 | 80.5 | 94.5 | 32.8 | 26.3 | 30.7 | 40.3 | |
| TLCNumber of experts=32021.11 | 66.7 | 75.7 | 68.3 | 48.8 | 84.6 | 67 | 80.8 | 97.2 | 31.3 | 24.7 | 31.6 | 39.6 | |
| cRT2021.11 | 66.4 | 70.2 | 63.3 | 49.2 | 82.6 | 65.1 | 83.2 | 95.3 | 32.5 | 27.2 | 37.4 | 48.8 | |
| RIDE2021.11 | 66.2 | 75.8 | 70.3 | 47.1 | 84.5 | 68.2 | 85.1 | 94.7 | 31.9 | 24.5 | 35.7 | 42.4 | |
| tau-norm2021.11 | 66.1 | 71.6 | 59.7 | 48.5 | 82.9 | 68.4 | 83.1 | 94.7 | 33 | 27.8 | 38.1 | 50.4 | |
| OLTR2021.11 | 66 | 72.8 | 67 | 42.3 | 82.9 | 67.1 | 85 | 96.3 | 34.8 | 25.6 | 32.6 | 42.3 | |
| Focal Loss2021.11 | 65.4 | 73.7 | 62.8 | 43.4 | 83.9 | 68.4 | 86.2 | 94.5 | 35.3 | 28.3 | 33.2 | 45.1 |