Image Classification on CIFAR-10 (NLL and Runtime Metrics)
0.185NLLSampled LLA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Sampled LLABackbone=ResNet-562026.02 | 0.185 | 14,600 | 2,840 | |
| ELLABackbone=ResNet-562026.02 | 0.187 | 1,130 | 91 | |
| MF-VIBackbone=ResNet-562026.02 | 0.188 | 1.97 | 1.18 | |
| VaLLA 200Backbone=ResNet-562026.02 | 0.188 | 26,300 | 363.8 | |
| LLA KFACBackbone=ResNet-562026.02 | 0.193 | 71.3 | 4.13 | |
| LLA DiagBackbone=ResNet-562026.02 | 0.195 | 40.67 | 1.12 | |
| Sampled LLABackbone=ResNet-442026.02 | 0.2 | 11,000 | 2,510 | |
| VaLLA 200Backbone=ResNet-442026.02 | 0.201 | 16,700 | 272.9 | |
| LLA* KFACBackbone=ResNet-562026.02 | 0.202 | 62.2 | 2.18 | |
| ELLABackbone=ResNet-442026.02 | 0.204 | 1,120 | 78.3 | |
| MF-VIBackbone=ResNet-442026.02 | 0.206 | 1.63 | 1.03 | |
| LLA KFACBackbone=ResNet-442026.02 | 0.213 | 63.1 | 3.62 | |
| LLA*Backbone=ResNet-562026.02 | 0.213 | 5,550 | 1.16 | |
| LLA DiagBackbone=ResNet-442026.02 | 0.218 | 40.4 | 0.947 | |
| SNGPBackbone=ResNet-562026.02 | 0.229 | 43.5 | 3.01 | |
| GAPA (ours)Backbone=ResNet-442026.02 | 0.23 | 8.03 | 2.85 | |
| GAPA (ours)Backbone=ResNet-562026.02 | 0.23 | 10.29 | 3.3 | |
| LLA* KFACBackbone=ResNet-442026.02 | 0.232 | 58 | 1.97 | |
| LLA*Backbone=ResNet-442026.02 | 0.237 | 4,980 | 0.962 | |
| SNGPBackbone=ResNet-442026.02 | 0.242 | 35 | 2.89 | |
| MAPBackbone=ResNet-562026.02 | 0.252 | — | 0.949 | |
| MAPBackbone=ResNet-442026.02 | 0.275 | — | 0.761 | |
| GP (subset)Backbone=ResNet-562026.02 | 0.403 | 8,420 | 382 | |
| GP (subset)Backbone=ResNet-442026.02 | 0.424 | 8,250 | 357 |