Learning to Defer on CIFAR-10H
96.1System AccuracyDecoupled
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DecoupledNumber of annotators (J)=202026.04 | 96.1 | 88.9 | |
| DecoupledNumber of annotators (J)=52026.04 | 96 | 89.2 | |
| OvANumber of annotators (J)=52026.04 | 95.9 | 88.9 | |
| A-SMNumber of annotators (J)=52026.04 | 95.9 | 89 | |
| DecoupledNumber of annotators (J)=102026.04 | 95.8 | 89.2 | |
| PiCCENumber of annotators (J)=102026.04 | 95.7 | 89 | |
| OvANumber of annotators (J)=202026.04 | 95.6 | 89 | |
| OvANumber of annotators (J)=102026.04 | 95.4 | 79.9 | |
| PiCCENumber of annotators (J)=52026.04 | 95.4 | 88.9 | |
| PiCCENumber of annotators (J)=202026.04 | 95.3 | 89 | |
| Add. CENumber of annotators (J)=52026.04 | 95.3 | 88.9 | |
| A-SMNumber of annotators (J)=102026.04 | 95.2 | 74.7 | |
| Add. CENumber of annotators (J)=102026.04 | 95.2 | 88.8 | |
| Add. CENumber of annotators (J)=202026.04 | 95.1 | 74.2 | |
| Mao25Number of annotators (J)=52026.04 | 95 | 11.6 | |
| A-SMNumber of annotators (J)=202026.04 | 94.9 | 47 | |
| Mao25Number of annotators (J)=102026.04 | 94.8 | 7.7 | |
| Mao25Number of annotators (J)=202026.04 | 94.8 | 4.5 |