Image Classification on Tiny ImageNet (Validation Accuracy)
68.57Validation AccuracyStriaNet-M2
Evaluation results
| Method | Links | |
|---|---|---|
| StriaNet-M2Rotation (s)=51.91, Mult (s)=31.67, Overall (s)=83.582026.01 | 68.57 | |
| StriaNet-M1Rotation (s)=34.63, Mult (s)=19.13, Overall (s)=53.762026.01 | 67.49 | |
| MobileNetV2Rotation (s)=107.55, Mult (s)=21.91, Overall (s)=129.462026.01 | 67.37 | |
| ResNet-50-PrunedRotation (s)=70.29, Mult (s)=36.13, Overall (s)=106.432026.01 | 65.54 | |
| ResNet-50Rotation (s)=150.69, Mult (s)=140.00, Overall (s)=254.692026.01 | 65.5 | |
| VGG-16Rotation (s)=77.89, Mult (s)=254.31, Overall (s)=323.202026.01 | 65 | |
| VGG-16-PrunedRotation (s)=41.36, Mult (s)=56.01, Overall (s)=97.372026.01 | 64.94 | |
| Full dataset2024.06 | 37.6 | |
| MTTipc=502024.06 | 28 | |
| MCTipc=502024.06 | 27.6 | |
| DMipc=502024.06 | 24.1 | |
| MTTipc=102024.06 | 23.2 | |
| MCTipc=102024.06 | 22.6 | |
| Randomipc=502024.06 | 15 | |
| DMipc=102024.06 | 12.9 | |
| MCTipc=12024.06 | 9.6 | |
| MTTipc=12024.06 | 8.8 | |
| Randomipc=102024.06 | 5 | |
| DMipc=12024.06 | 3.9 | |
| Randomipc=12024.06 | 1.4 | |
| SAFLeSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.6458 | |
| SAFLeSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.6458 | |
| SAFLeSetting=s = 10, Partition=NIID-22025.12 | 0.6458 | |
| SAFLeSetting=s = 5, Partition=NIID-22025.12 | 0.6458 | |
| DeepAFLSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.6235 | |
| DeepAFLSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.6235 | |
| DeepAFLSetting=s = 10, Partition=NIID-22025.12 | 0.6235 | |
| DeepAFLSetting=s = 5, Partition=NIID-22025.12 | 0.6235 | |
| CLIPEvaluation protocol=Zero-shot2024.07 | 0.5977 | |
| NOVIC (FT6)Evaluation protocol=Zero-shot, Frequency Threshold=62024.07 | 0.5736 | |
| NOVIC (FT2)Evaluation protocol=Zero-shot, Frequency Threshold=22024.07 | 0.5583 | |
| AFLSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.5467 | |
| AFLSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.5467 | |
| AFLSetting=s = 10, Partition=NIID-22025.12 | 0.5467 | |
| AFLSetting=s = 5, Partition=NIID-22025.12 | 0.5467 | |
| NOVIC (FT9)Evaluation protocol=Zero-shot, Frequency Threshold=92024.07 | 0.5453 | |
| NOVIC (FT0)Evaluation protocol=Zero-shot, Frequency Threshold=02024.07 | 0.5378 | |
| FedDynSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.4772 | |
| FedProxSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.4647 | |
| MOONSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.4621 | |
| FedNTDSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.4617 | |
| FedAvgSetting=alpha = 0.1, Partition=NIID-12025.12 | 0.4604 | |
| FedDynSetting=s = 10, Partition=NIID-22025.12 | 0.4136 | |
| FedAvgSetting=s = 10, Partition=NIID-22025.12 | 0.3906 | |
| FedProxSetting=s = 10, Partition=NIID-22025.12 | 0.3897 | |
| MOONSetting=s = 10, Partition=NIID-22025.12 | 0.3879 | |
| FedNTDSetting=s = 10, Partition=NIID-22025.12 | 0.3755 | |
| FedDynSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.3519 | |
| FedDynSetting=s = 5, Partition=NIID-22025.12 | 0.3518 | |
| FedAvgSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.3263 | |
| MOONSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.3238 | |
| FedProxSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.3226 | |
| FedNTDSetting=alpha = 0.01, Partition=NIID-12025.12 | 0.3186 | |
| FedAvgSetting=s = 5, Partition=NIID-22025.12 | 0.2966 | |
| MOONSetting=s = 5, Partition=NIID-22025.12 | 0.2924 | |
| FedProxSetting=s = 5, Partition=NIID-22025.12 | 0.2917 | |
| FedNTDSetting=s = 5, Partition=NIID-22025.12 | 0.2901 |