Failure Prediction on CIFAR-10-LT (test)
83.9AUC (All)OLTR
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OLTR2021.11 | 83.9 | 79.6 | 83.9 | 85.9 | 79.6 | 72.9 | 82.4 | 80.7 | 18.8 | 11.2 | 19.6 | 33.2 | |
| TLCNumber of experts=42021.11 | 83.9 | 84 | 87.8 | 83.8 | 65.7 | 66.3 | 58.2 | 68.2 | 12.5 | 11.4 | 11.3 | 15.9 | |
| tau-norm2021.11 | 83.8 | 79.5 | 85.2 | 83.5 | 67.9 | 71.2 | 71.9 | 59.7 | 17.8 | 12 | 20.7 | 22.3 | |
| cRT2021.11 | 83.7 | 79.8 | 84.1 | 85.3 | 67.4 | 71.2 | 70.3 | 62.1 | 18.4 | 11.5 | 19.8 | 21.3 | |
| TLCNumber of experts=32021.11 | 83.7 | 83 | 87.1 | 83.6 | 68 | 68.7 | 60.8 | 72.7 | 13.1 | 11.3 | 12.4 | 16.8 | |
| TLCNumber of experts=22021.11 | 83.5 | 84.3 | 85.6 | 83.4 | 68.9 | 66.7 | 68 | 71.2 | 12.8 | 10.6 | 13.1 | 15.8 | |
| LDAM-DRW2021.11 | 83.1 | 79.6 | 86.3 | 85.2 | 69.3 | 71.7 | 72.9 | 62.1 | 18.9 | 12.4 | 22 | 24.5 | |
| RIDE2021.11 | 82.9 | 81.7 | 85.4 | 84.2 | 68.7 | 71.9 | 70.5 | 62.3 | 15.9 | 9.8 | 17.9 | 22.4 | |
| Focal Loss2021.11 | 75.7 | 80.5 | 75.6 | 85.1 | 79.8 | 72.5 | 80.9 | 80.3 | 20.1 | 11.7 | 19.7 | 33.3 |