Image Classification on CIFAR100 (test) (Accuracy and NLL)
92.21AccuracyLookaround
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LookaroundBackbone=ViT-B/16, #param.=85.72M, Resolution=224x2242023.06 | 92.21 | 0.267 | — | |
| LookaheadBackbone=ViT-B/16, #param.=85.72M, Resolution=224x2242023.06 | 91.76 | 0.28 | — | |
| AdamBackbone=ViT-B/16, #param.=85.72M, Resolution=224x2242023.06 | 91.55 | 0.298 | — | |
| SWABackbone=ViT-B/16, #param.=85.72M, Resolution=224x2242023.06 | 91.32 | 0.304 | — | |
| Adam†Backbone=ViT-B/16, #param.=85.72M, Resolution=224x2242023.06 | 87.13 | — | — | |
| LookaroundBackbone=ResNet50, #param.=23.71M, Resolution=224x2242023.06 | 85.2 | 0.658 | — | |
| SWABackbone=ResNet50, #param.=23.71M, Resolution=224x2242023.06 | 84.81 | 0.668 | — | |
| LookaheadBackbone=ResNet50, #param.=23.71M, Resolution=224x2242023.06 | 84.78 | 0.676 | — | |
| SGDMBackbone=ResNet50, #param.=23.71M, Resolution=224x2242023.06 | 84.5 | 0.692 | — | |
| OTTERBackbone=ViT-B/16, Setting=Zero-shot2024.04 | 67.9 | — | — | |
| Prior MatchingBackbone=ViT-B/16, Setting=Zero-shot2024.04 | 64.1 | — | — | |
| Zero-shotBackbone=ViT-B/16, Setting=Zero-shot2024.04 | 63.8 | — | — | |
| MTTImg/Cls=502022.06 | 47.7 | — | — | |
| FBPCipc=502023.10 | 44.47 | 2.63 | — | |
| FRePoImg/Cls=50, arch=Conv-BN2022.06 | 44.3 | — | — | |
| DMImg/Cls=502022.06 | 43.6 | — | — | |
| DSAImg/Cls=502022.06 | 42.8 | — | — | |
| FRePoImg/Cls=10, arch=Conv-BN2022.06 | 42.5 | — | — | |
| FRePoImg/Cls=10, arch=Conv-IN2022.06 | 40.9 | — | — | |
| MTTImg/Cls=102022.06 | 40.1 | — | — | |
| FBPCipc=102023.10 | 39.7 | 2.67 | — | |
| BPC-fKLipc=502023.10 | 37.1 | 3.28 | — | |
| Randomipc=502023.10 | 35.1 | 3.35 | — | |
| DSAImg/Cls=102022.06 | 32.3 | — | — | |
| FRePoImg/Cls=10, arch=DCConv-IN2022.06 | 31.2 | — | — | |
| DMImg/Cls=102022.06 | 29.7 | — | — | |
| FRePoImg/Cls=1, arch=Conv-BN2022.06 | 28.7 | — | — | |
| KIPImg/Cls=102022.06 | 28.3 | — | — | |
| BPC-fKLipc=102023.10 | 28.1 | 3.53 | — | |
| FRePoImg/Cls=1, arch=Conv-IN2022.06 | 25.9 | — | — | |
| FRePoImg/Cls=1, arch=DCConv-IN2022.06 | 24.8 | — | — | |
| MTTImg/Cls=12022.06 | 24.3 | — | — | |
| FBPCipc=12023.10 | 21 | 3.76 | — | |
| Randomipc=102023.10 | 18 | 4.57 | — | |
| DeepInversionalpha=0.5, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 17.12 | — | — | |
| FedMITRalpha=0.5, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 17.09 | — | — | |
| DSAImg/Cls=12022.06 | 16.8 | — | — | |
| FedMITRalpha=0.3, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 16.45 | — | — | |
| KIPImg/Cls=12022.06 | 15.7 | — | — | |
| DeepInversionalpha=0.3, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 15.24 | — | — | |
| Co-Boostingalpha=0.5, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 14.87 | — | — | |
| BPC-fKLipc=12023.10 | 14.7 | 4.17 | — | |
| FedAvgalpha=0.5, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 13.99 | — | — | |
| Co-Boostingalpha=0.3, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 13.25 | — | — | |
| FedMITRalpha=0.1, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 13.12 | — | — | |
| FedAvgalpha=0.3, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 12.3 | — | — | |
| DMImg/Cls=12022.06 | 12.2 | — | — | |
| FedMITRalpha=0.05, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 11.35 | — | — | |
| DeepInversionalpha=0.1, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 10.86 | — | — | |
| BPC-fKLimages per class (ipc)=1, inference method=HMC, augmentation=none2022.10 | 10.55 | 4.2366 | — | |
| BPC-Wimages per class (ipc)=1, inference method=HMC, augmentation=none2022.10 | 10.35 | 4.2066 | — | |
| Co-Boostingalpha=0.1, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 9.23 | — | — | |
| DeepInversionalpha=0.05, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 9.02 | — | — | |
| FedMITRalpha=0.01, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 8.89 | — | — | |
| FedAvgalpha=0.1, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 8.55 | — | — | |
| Co-Boostingalpha=0.05, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 7.33 | — | — | |
| FedAvgalpha=0.05, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 6.62 | — | — | |
| DeepInversionalpha=0.01, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 5.89 | — | — | |
| Randomipc=12023.10 | 4.82 | 5.55 | — | |
| BPC-rKLimages per class (ipc)=1, inference method=HMC, augmentation=none2022.10 | 4.6 | 4.6665 | — | |
| Co-Boostingalpha=0.01, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 4.51 | — | — | |
| Randomimages per class (ipc)=1, inference method=HMC, augmentation=none2022.10 | 4.2 | 4.7063 | — | |
| FedAvgalpha=0.01, Backbone=DeiT/16-Tiny, Pre-trained=ImageNet-1K, Evaluation Protocol=one-shot, Number of Clients=102026.05 | 4.02 | — | — | |
| LARSBatch-size=10242026.03 | — | — | 52.93 | |
| LARSBatch-size=20482026.03 | — | — | 50.91 | |
| LARSBatch-size=40962026.03 | — | — | 48.64 | |
| LBTBatch-size=10242026.03 | — | — | 83.3 | |
| LBTBatch-size=20482026.03 | — | — | 75.92 | |
| LBTBatch-size=40962026.03 | — | — | 70.24 | |
| LRSBatch-size=10242026.03 | — | — | 7.5 | |
| LRSBatch-size=20482026.03 | — | — | 5 | |
| LRSBatch-size=40962026.03 | — | — | 5 | |
| PoLoBatch-size=10242026.03 | — | — | 82.9 | |
| PoLoBatch-size=20482026.03 | — | — | 81.13 | |
| PoLoBatch-size=40962026.03 | — | — | 79.5 | |
| TulaBatch-size=10242026.03 | — | — | 84.42 | |
| TulaBatch-size=20482026.03 | — | — | 82.58 | |
| TulaBatch-size=40962026.03 | — | — | 81.14 |