Image Classification on CIFAR-10H
2.01Error Rate (%)MAP TS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MAP TSBackbone=DenseNet-BC2021.09 | 2.01 | — | — | |
| IMax BinningBackbone=DenseNet-BC2021.09 | 2.04 | — | — | |
| Ensemble TSBackbone=DenseNet-BC2021.09 | 2.17 | — | — | |
| P+LBackbone=DenseNet-BC, Calibration=Uncalibrated2021.09 | 2.22 | — | — | |
| MAP TSBackbone=PreResNet-1642021.09 | 2.43 | — | — | |
| IMax BinningBackbone=PreResNet-1642021.09 | 2.43 | — | — | |
| Ensemble TSBackbone=PreResNet-1642021.09 | 2.46 | — | — | |
| MAP TSBackbone=ResNet-1642021.09 | 2.78 | — | — | |
| Ensemble TSBackbone=ResNet-1642021.09 | 2.82 | — | — | |
| IMax BinningBackbone=ResNet-1642021.09 | 2.85 | — | — | |
| P+LBackbone=PreResNet-164, Calibration=Uncalibrated2021.09 | 2.9 | — | — | |
| P+LBackbone=ResNet-164, Calibration=Uncalibrated2021.09 | 3.05 | — | — | |
| Base ModelBackbone=DenseNet-BC2021.09 | 3.25 | — | — | |
| L+LBackbone=DenseNet-BC2021.09 | 3.39 | — | — | |
| Ensemble TSBackbone=ResNet-1102021.09 | 3.76 | — | — | |
| IMax BinningBackbone=ResNet-1102021.09 | 3.8 | — | — | |
| MAP TSBackbone=ResNet-1102021.09 | 3.83 | — | — | |
| L+LBackbone=PreResNet-1642021.09 | 4.36 | — | — | |
| P+LBackbone=ResNet-110, Calibration=Uncalibrated2021.09 | 4.4 | — | — | |
| Human2021.09 | 4.62 | — | — | |
| L+LBackbone=ResNet-1102021.09 | 4.7 | — | — | |
| L+LBackbone=ResNet-1642021.09 | 4.71 | — | — | |
| Base ModelBackbone=PreResNet-1642021.09 | 5 | — | — | |
| Base ModelBackbone=ResNet-1642021.09 | 6.1 | — | — | |
| Base ModelBackbone=ResNet-1102021.09 | 11.28 | — | — | |
| DS-FLMethod Category=KD-based2022.12 | — | 65.27 | — | |
| Fed-ETMethod Category=KD-based2022.12 | — | 78.66 | — | |
| FedDFMethod Category=KD-based2022.12 | — | 73.81 | — | |
| Federated DropoutMethod Category=PT-based2022.12 | — | 46.64 | — | |
| FedRolexMethod Category=PT-based2022.12 | — | 69.44 | — | |
| FGRTemperature Scaling=false2026.06 | — | 91.9 | 5.1 | |
| FGRTemperature Scaling=true2026.06 | — | 91.9 | 4.5 | |
| FGR + RobustTemperature Scaling=false2026.06 | — | 90.3 | 8.3 | |
| FGR + RobustTemperature Scaling=true2026.06 | — | 90.3 | 2.8 | |
| HeteroFLMethod Category=PT-based2022.12 | — | 63.9 | — | |
| Homogeneous (largest)Method Category=Homogeneous, Model Capacity=largest2022.12 | — | 75.74 | — | |
| Homogeneous (smallest)Method Category=Homogeneous, Model Capacity=smallest2022.12 | — | 38.82 | — | |
| MoCaETemperature Scaling=false2026.06 | — | 92 | 4.9 | |
| MoCaETemperature Scaling=true2026.06 | — | 92 | 4.2 | |
| Robust FilteredTemperature Scaling=false2026.06 | — | 91 | 1.3 | |
| Robust FilteredTemperature Scaling=true2026.06 | — | 91 | 0.7 | |
| Robust MoETemperature Scaling=false2026.06 | — | 90.4 | 9 | |
| Robust MoETemperature Scaling=true2026.06 | — | 90.4 | 3.6 | |
| Single ExpertTemperature Scaling=false2026.06 | — | 92.2 | 5.4 | |
| Single ExpertTemperature Scaling=true2026.06 | — | 92.2 | 4.8 | |
| Vanilla MoETemperature Scaling=false2026.06 | — | 92 | 5.5 | |
| Vanilla MoETemperature Scaling=true2026.06 | — | 92 | 4.9 |