Image Classification on CIFAR10 (test) (Accuracy & NLL)
98.71AccuracyLookaround
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LookaroundBackbone=ViT-B/16, #param.=85.65M, Resolution=224x2242023.06 | 98.71 | 0.041 | |
| LookaheadBackbone=ViT-B/16, #param.=85.65M, Resolution=224x2242023.06 | 98.51 | 0.047 | |
| SWABackbone=ViT-B/16, #param.=85.65M, Resolution=224x2242023.06 | 98.47 | 0.049 | |
| AdamBackbone=ViT-B/16, #param.=85.65M, Resolution=224x2242023.06 | 98.34 | 0.06 | |
| Adam†Backbone=ViT-B/16, #param.=85.65M, Resolution=224x2242023.06 | 98.13 | — | |
| LookaroundBackbone=ResNet50, #param.=23.52M, Resolution=224x2242023.06 | 97.82 | 0.099 | |
| LookaheadBackbone=ResNet50, #param.=23.52M, Resolution=224x2242023.06 | 97.65 | 0.103 | |
| SGDMBackbone=ResNet50, #param.=23.52M, Resolution=224x2242023.06 | 97.55 | 0.109 | |
| SWABackbone=ResNet50, #param.=23.52M, Resolution=224x2242023.06 | 97.48 | 0.105 | |
| LookaroundBackbone=ResNet152, Resolution=32x32, Initialization=random2023.06 | 97.02 | 0.14 | |
| SWABackbone=ResNet152, Resolution=32x32, Initialization=random2023.06 | 96.82 | 0.13 | |
| LookaroundBackbone=ResNet101, Resolution=32x32, Initialization=random2023.06 | 96.73 | 0.14 | |
| LookaroundBackbone=ResNext50, Resolution=32x32, Initialization=random2023.06 | 96.7 | 0.13 | |
| LookaheadBackbone=ResNet101, Resolution=32x32, Initialization=random2023.06 | 96.61 | 0.15 | |
| LookaroundBackbone=ResNet50, Resolution=32x32, Initialization=random2023.06 | 96.59 | 0.14 | |
| LookaheadBackbone=ResNext50, Resolution=32x32, Initialization=random2023.06 | 96.47 | 0.15 | |
| LookaheadBackbone=ResNet152, Resolution=32x32, Initialization=random2023.06 | 96.46 | 0.15 | |
| SWABackbone=ResNet50, Resolution=32x32, Initialization=random2023.06 | 96.42 | 0.14 | |
| LookaheadBackbone=ResNet50, Resolution=32x32, Initialization=random2023.06 | 96.38 | 0.16 | |
| SWABackbone=ResNet101, Resolution=32x32, Initialization=random2023.06 | 96.34 | 0.14 | |
| SGDMBackbone=ResNet152, Resolution=32x32, Initialization=random2023.06 | 96.28 | 0.16 | |
| SGDMBackbone=ResNet101, Resolution=32x32, Initialization=random2023.06 | 96.16 | 0.16 | |
| SWABackbone=ResNext50, Resolution=32x32, Initialization=random2023.06 | 96.09 | 0.16 | |
| SGDMBackbone=ResNet50, Resolution=32x32, Initialization=random2023.06 | 95.96 | 0.16 | |
| SGDMBackbone=ResNext50, Resolution=32x32, Initialization=random2023.06 | 95.72 | 0.17 | |
| SWADBackbone=ResNet50, Resolution=32x32, Initialization=random2023.06 | 95.39 | 0.19 | |
| SWADBackbone=ResNet152, Resolution=32x32, Initialization=random2023.06 | 95 | 0.2 | |
| SWABackbone=VGG19, Resolution=32x32, Initialization=random2023.06 | 94.89 | 0.21 | |
| LookaheadBackbone=VGG19, Resolution=32x32, Initialization=random2023.06 | 94.72 | 0.23 | |
| SWADBackbone=ResNet101, Resolution=32x32, Initialization=random2023.06 | 94.49 | 0.22 | |
| LookaroundBackbone=VGG19, Resolution=32x32, Initialization=random2023.06 | 94.44 | 0.25 | |
| SGDMBackbone=VGG19, Resolution=32x32, Initialization=random2023.06 | 93.92 | 0.26 | |
| SWADBackbone=ResNext50, Resolution=32x32, Initialization=random2023.06 | 93.89 | 0.26 | |
| SWADBackbone=VGG19, Resolution=32x32, Initialization=random2023.06 | 93.23 | 0.29 | |
| FBPC-isotropicipc=502023.10 | 71.33 | 1.03 | |
| FBPCipc=502023.10 | 71.23 | 1.03 | |
| BPC-fKLipc=502023.10 | 64.74 | 1.26 | |
| FBPCipc=102023.10 | 62.33 | 1.31 | |
| FBPC-isotropicipc=102023.10 | 61.43 | 1.35 | |
| BPC-Wipc=100, inference_protocol=HMC, data_augmentation=false2022.10 | 58.22 | 1.6294 | |
| BPC-W (MTT)ipc=20, Sampler=A-SGHMC, Augmentation=True2022.10 | 56.91 | 1.5439 | |
| BPC-fKLipc=100, inference_protocol=HMC, data_augmentation=false2022.10 | 56.25 | 1.5841 | |
| BPC-fKLipc=102023.10 | 56.19 | 1.48 | |
| BPC-fKLipc=50, inference_protocol=HMC, data_augmentation=false2022.10 | 55.57 | 1.4619 | |
| BPC-Wipc=50, inference_protocol=HMC, data_augmentation=false2022.10 | 54.24 | 1.4502 | |
| BPC-rKLipc=502023.10 | 51.86 | 1.95 | |
| BPC-fKLipc=20, Sampler=A-SGHMC, Augmentation=True2022.10 | 51.53 | 1.6701 | |
| Randomipc=502023.10 | 49.68 | 2.06 | |
| BPC-fKLipc=20, Sampler=HMC, Augmentation=False2022.10 | 49.1 | 1.6279 | |
| BPC-W (MTT)ipc=10, Sampler=A-SGHMC, Augmentation=True2022.10 | 48.9 | 1.6971 | |
| BPC-fKLipc=10, Sampler=A-SGHMC, Augmentation=True2022.10 | 48.78 | 1.6762 | |
| BPC-fKLipc=20, Sampler=HMC, Augmentation=True2022.10 | 48.33 | 1.644 | |
| BPC-W (MTT)ipc=20, Sampler=HMC, Augmentation=True2022.10 | 46.06 | 1.7334 | |
| BPC-W (MTT)ipc=20, Sampler=HMC, Augmentation=False2022.10 | 45.46 | 1.7336 | |
| BPC-rKLipc=20, Sampler=A-SGHMC, Augmentation=True2022.10 | 43.07 | 1.8555 | |
| BPC-fKLipc=10, Sampler=HMC, Augmentation=False2022.10 | 42.94 | 1.7292 | |
| BPC-fKLipc=10, Sampler=HMC, Augmentation=True2022.10 | 42.52 | 1.7334 | |
| Randomipc=100, inference_protocol=HMC, data_augmentation=false2022.10 | 42.42 | 2.143 | |
| BPC-rKLipc=100, inference_protocol=HMC, data_augmentation=false2022.10 | 42.2 | 2.1695 | |
| BPC-rKLipc=50, inference_protocol=HMC, data_augmentation=false2022.10 | 39.78 | 2.0692 | |
| Randomipc=50, inference_protocol=HMC, data_augmentation=false2022.10 | 39.22 | 2.1443 | |
| Randomipc=20, Sampler=A-SGHMC, Augmentation=True2022.10 | 38.32 | 1.8999 | |
| BPC-rKLipc=102023.10 | 37.92 | 2.47 | |
| BPC-rKLipc=10, Sampler=A-SGHMC, Augmentation=True2022.10 | 37.89 | 1.9492 | |
| BPC-rKLipc=20, Sampler=HMC, Augmentation=False2022.10 | 36.86 | 1.8848 | |
| BPC-W (MTT)ipc=10, Sampler=HMC, Augmentation=True2022.10 | 36.46 | 1.9307 | |
| FBPCipc=12023.10 | 35.45 | 3.79 | |
| BPC-W (MTT)ipc=10, Sampler=HMC, Augmentation=False2022.10 | 35.35 | 1.945 | |
| BPC-rKLipc=20, Sampler=HMC, Augmentation=True2022.10 | 35.18 | 1.954 | |
| BPC-fKLipc=1, Sampler=HMC, Augmentation=True2022.10 | 34.68 | 1.9574 | |
| BPC-fKLipc=12023.10 | 34.5 | 3.86 | |
| BPC-W (MTT)ipc=1, Sampler=HMC, Augmentation=False2022.10 | 34.35 | 1.9311 | |
| BPC-fKLipc=1, Sampler=HMC, Augmentation=False2022.10 | 33.54 | 2.0253 | |
| BPC-W (MTT)ipc=1, Sampler=HMC, Augmentation=True2022.10 | 33.38 | 1.9589 | |
| Randomipc=20, Sampler=HMC, Augmentation=False2022.10 | 32.92 | 2.0164 | |
| Randomipc=20, Sampler=HMC, Augmentation=True2022.10 | 32.92 | 2.0164 | |
| BPC-rKLipc=10, Sampler=HMC, Augmentation=False2022.10 | 32.53 | 1.9627 | |
| Randomipc=102023.10 | 32.48 | 2.98 | |
| FBPC-isotropicipc=12023.10 | 32 | 3.4 | |
| Randomipc=10, Sampler=A-SGHMC, Augmentation=True2022.10 | 30.85 | 2.1953 | |
| BPC-rKLipc=10, Sampler=HMC, Augmentation=True2022.10 | 30.17 | 2.0251 | |
| BPC-W (MTT)ipc=1, Sampler=A-SGHMC, Augmentation=True2022.10 | 29.34 | 2.14 | |
| BPC-fKLipc=1, Sampler=A-SGHMC, Augmentation=True2022.10 | 28.23 | 2.1426 | |
| Randomipc=10, Sampler=HMC, Augmentation=False2022.10 | 28.07 | 2.107 | |
| Randomipc=10, Sampler=HMC, Augmentation=True2022.10 | 28.07 | 2.107 | |
| BPC-rKLipc=1, Sampler=HMC, Augmentation=False2022.10 | 24.72 | 2.1635 | |
| BPC-rKLipc=1, Sampler=HMC, Augmentation=True2022.10 | 24.16 | 2.1688 | |
| BPC-rKLipc=1, Sampler=A-SGHMC, Augmentation=True2022.10 | 21.62 | 2.4617 | |
| BPC-rKLipc=12023.10 | 20.44 | 4.51 | |
| Randomipc=1, Sampler=HMC, Augmentation=False2022.10 | 17.45 | 2.4507 | |
| Randomipc=1, Sampler=HMC, Augmentation=True2022.10 | 17.45 | 2.4507 | |
| Randomipc=12023.10 | 16.3 | 4.66 | |
| Randomipc=1, Sampler=A-SGHMC, Augmentation=True2022.10 | 14.14 | 2.9798 |