Failure Prediction on CIFAR-100-LT (test)
77.9AUC (All)TLC
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TLCNumber of experts=22021.11 | 77.9 | 85.7 | 78.7 | 60 | 78.3 | 64.3 | 77.7 | 91.2 | 23.2 | 17.8 | 23 | 22.4 | |
| TLCNumber of experts=32021.11 | 76.9 | 84.5 | 78.8 | 57.5 | 79.8 | 67.1 | 76.5 | 90.6 | 22.8 | 14.8 | 21.9 | 24.6 | |
| TLCNumber of experts=42021.11 | 76.7 | 85.3 | 77.7 | 58.6 | 80.5 | 66.8 | 80.6 | 89.8 | 21.2 | 21.7 | 20.6 | 25.6 | |
| RIDE2021.11 | 76.3 | 85.5 | 79.5 | 60 | 79.5 | 66.2 | 80.1 | 89.7 | 24.1 | 14.5 | 23.8 | 34.3 | |
| cRT2021.11 | 74.1 | 83.4 | 79.7 | 53.5 | 78.6 | 64.5 | 78.9 | 89.2 | 30.2 | 19.8 | 28.9 | 43.8 | |
| tau-norm2021.11 | 73.9 | 85.5 | 75.1 | 54.8 | 78.9 | 66 | 83 | 89.3 | 29.8 | 17.2 | 29.7 | 42.5 | |
| OLTR2021.11 | 73.5 | 85.6 | 79.2 | 56.3 | 79.5 | 69.5 | 79.6 | 90.4 | 23.6 | 16.2 | 22.2 | 34.5 | |
| Focal Loss2021.11 | 73.3 | 83.7 | 72.9 | 53.3 | 78.9 | 66.4 | 81.2 | 89.5 | 24.2 | 16 | 22.3 | 35 | |
| LDAM-DRW2021.11 | 72.7 | 85.7 | 75.5 | 55.6 | 81.8 | 68.9 | 76.7 | 92.1 | 30.9 | 18.7 | 30.8 | 43.6 |