Image Classification on Tiny-ImageNet (Accuracy %)
86.93Accuracy (%)LoRSP
Evaluation results
| Method | Links | |
|---|---|---|
| LoRSPPre-trained Backbone=ViT-B/322026.06 | 86.93 | |
| HIVEFoundation Model=CLIP2026.03 | 86.71 | |
| AS-LoRADP Budget (ϵ)=32026.05 | 86.66 | |
| BaseFoundation Model=CLIP2026.03 | 86.65 | |
| SAFoundation Model=CLIP2026.03 | 86.51 | |
| LoR-VPPre-trained Backbone=ViT-B/322026.06 | 85.77 | |
| FFA-LoRADP Budget (ϵ)=32026.05 | 85.5 | |
| RoLoRADP Budget (ϵ)=32026.05 | 84.62 | |
| LPPre-trained Backbone=ViT-B/322026.06 | 83.95 | |
| AS-LoRADP Budget (ϵ)=12026.05 | 83.71 | |
| VPTPre-trained Backbone=ViT-B/322026.06 | 83.54 | |
| FFA-LoRADP Budget (ϵ)=12026.05 | 83.52 | |
| HIVEFoundation Model=SigLIP2026.03 | 82.48 | |
| SAFoundation Model=SigLIP2026.03 | 82.46 | |
| AutoVPPre-trained Backbone=ViT-B/322026.06 | 82.43 | |
| RoLoRADP Budget (ϵ)=12026.05 | 82.34 | |
| BaseFoundation Model=SigLIP2026.03 | 82.27 | |
| LSFormerArchitecture=LSFormer-4-384, Timesteps=42026.05 | 71.61 | |
| Spikinghash-MArchitecture=Spikinghash-M, Param (M)=6.28, Time Step=42025.01 | 68.26 | |
| SAFormerArchitecture=SAFormer-4-384, Timesteps=42026.05 | 67.28 | |
| Spikingformer-CMLArchitecture=Spikingformer, Param (M)=8.40, Time Step=42025.01 | 66.59 | |
| SpikformerArchitecture=Spikformer-4-384, Timesteps=42026.05 | 66.03 | |
| S-TransformerArchitecture=Spikingformer-4-384, Timesteps=42026.05 | 65.71 | |
| SpikformerArchitecture=Spikformer, Param (M)=9.40, Time Step=42025.01 | 65.7 | |
| LM-HT(L=4)Architecture=VGG-13, Timesteps=22026.05 | 62.05 | |
| BPLearning Paradigm=BP-based2026.06 | 61.8 | |
| LM-HT(L=2)Architecture=VGG-13, Timesteps=42026.05 | 61.75 | |
| LM-HArchitecture=VGG-13, Timesteps=42026.05 | 59.51 | |
| DCTArchitecture=VGG-13, Timesteps=1252026.05 | 56.9 | |
| ASGLArchitecture=VGG-13, Param (M)=60.56, Time Step=82025.01 | 56.81 | |
| ASGLArchitecture=VGG-13, Timesteps=42026.05 | 56.57 | |
| TeacherArchitecture=ResNet322026.04 | 56.27 | |
| Offline-LTArchitecture=VGG-13, Param (M)=60.56, Time Step=162025.01 | 55.37 | |
| Offline-LTLArchitecture=VGG-13, Timesteps=162026.05 | 55.37 | |
| Online-LTLArchitecture=VGG-13, Param (M)=60.56, Time Step=162025.01 | 54.82 | |
| Online-LTLArchitecture=VGG-13, Timesteps=162026.05 | 54.82 | |
| QCFSArchitecture=VGG-16, Param (M)=65.87, Time Step=322025.01 | 53.54 | |
| Student-FullArchitecture=ResNet202026.04 | 51.51 | |
| Proposed methodLearning Paradigm=Forward-only2026.06 | 49.87 | |
| PODSSelection Ratio=70%, Backbone=ResNet-502026.05 | 49 | |
| Dyn. Sel. Aug.Selection Ratio=70%, Backbone=ResNet-502026.05 | 48.5 | |
| PODSSelection Ratio=50%, Backbone=ResNet-502026.05 | 46.9 | |
| CLIP-SelSelection Ratio=70%, Backbone=ResNet-502026.05 | 46 | |
| FAPDalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 45.35 | |
| FAPDncontalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 45.28 | |
| Dyn. Sel. Aug.Selection Ratio=50%, Backbone=ResNet-502026.05 | 45.1 | |
| Full DatasetSelection Ratio=100%, Backbone=ResNet-502026.05 | 45 | |
| FedRCLalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 44.89 | |
| FAPDnadptalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 44.67 | |
| FedCDAalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 44.56 | |
| RL-SelectorSelection Ratio=70%, Backbone=ResNet-502026.05 | 44.5 | |
| PODSSelection Ratio=30%, Backbone=ResNet-502026.05 | 44.5 | |
| DivBFKDDistillation setting=black-box, Real image budget (N)=10 K, Synthetic image budget (M)=50 K2026.04 | 44.25 | |
| FedNHalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 44.12 | |
| EL2NSelection Ratio=70%, Backbone=ResNet-502026.05 | 44 | |
| GlisterSelection Ratio=70%, Backbone=ResNet-502026.05 | 43.9 | |
| InfoBatchSelection Ratio=70%, Backbone=ResNet-502026.05 | 43.8 | |
| MOONalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 43.78 | |
| FedProxalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 43.48 | |
| Self-sup. proto.Selection Ratio=70%, Backbone=ResNet-502026.05 | 43.4 | |
| MoSoSelection Ratio=70%, Backbone=ResNet-502026.05 | 43.4 | |
| FedAvgalpha=0.5, Backbone=MobileNetV2, Local Epochs (E)=10, Number of Clients=102026.03 | 43.35 | |
| FS-BBTDistillation setting=black-box, Real image budget (N)=10 K, Synthetic image budget (M)=50 K2026.04 | 43.29 | |
| GraNdSelection Ratio=70%, Backbone=ResNet-502026.05 | 43.2 | |
| InfoBatchSelection Ratio=50%, Backbone=ResNet-502026.05 | 43.2 | |
| Random*Selection Ratio=70%, Backbone=ResNet-502026.05 | 43.1 | |
| Moderate-DSSelection Ratio=70%, Backbone=ResNet-502026.05 | 42.8 | |
| Random*Selection Ratio=50%, Backbone=ResNet-502026.05 | 42.8 | |
| DiT-OursIPC=502026.06 | 42.8 | |
| RandomSelection Ratio=70%, Backbone=ResNet-502026.05 | 42.2 | |
| InfoBatchSelection Ratio=30%, Backbone=ResNet-502026.05 | 42.2 | |
| Random*Selection Ratio=30%, Backbone=ResNet-502026.05 | 41.5 | |
| Dyn. Sel. Aug.Selection Ratio=30%, Backbone=ResNet-502026.05 | 41.5 | |
| DeeperForwardLearning Paradigm=Forward-only, Reproduced results=true2026.06 | 41.36 | |
| ForgettingSelection Ratio=70%, Backbone=ResNet-502026.05 | 41.2 | |
| Standard-KDDistillation setting=black-box, Real image budget (N)=10 K, Synthetic image budget (M)=50 K2026.04 | 40.42 | |
| BBKDDistillation setting=black-box, Real image budget (N)=10 K, Synthetic image budget (M)=50 K2026.04 | 40.01 | |
| CLIP-SelSelection Ratio=50%, Backbone=ResNet-502026.05 | 40 | |
| HerdingSelection Ratio=70%, Backbone=ResNet-502026.05 | 39.8 | |
| GlisterSelection Ratio=50%, Backbone=ResNet-502026.05 | 39.5 | |
| MoSoSelection Ratio=50%, Backbone=ResNet-502026.05 | 38.5 | |
| Moderate-DSSelection Ratio=50%, Backbone=ResNet-502026.05 | 38.2 | |
| Self-sup. proto.Selection Ratio=50%, Backbone=ResNet-502026.05 | 37.9 | |
| RandomSelection Ratio=50%, Backbone=ResNet-502026.05 | 37.2 | |
| EL2NSelection Ratio=50%, Backbone=ResNet-502026.05 | 37.1 | |
| GraNdSelection Ratio=50%, Backbone=ResNet-502026.05 | 36.3 | |
| DiT-OursIPC=102026.06 | 35.9 | |
| ForgettingSelection Ratio=50%, Backbone=ResNet-502026.05 | 33 | |
| CLIP-SelSelection Ratio=30%, Backbone=ResNet-502026.05 | 31.7 | |
| HerdingSelection Ratio=50%, Backbone=ResNet-502026.05 | 31.6 | |
| MoSoSelection Ratio=30%, Backbone=ResNet-502026.05 | 31.2 | |
| RL-SelectorSelection Ratio=30%, Backbone=ResNet-502026.05 | 31.1 | |
| Moderate-DSSelection Ratio=30%, Backbone=ResNet-502026.05 | 30.6 | |
| GlisterSelection Ratio=30%, Backbone=ResNet-502026.05 | 30.1 | |
| RandomSelection Ratio=30%, Backbone=ResNet-502026.05 | 29.8 | |
| GraNdSelection Ratio=30%, Backbone=ResNet-502026.05 | 29.7 | |
| HerdingSelection Ratio=30%, Backbone=ResNet-502026.05 | 29.4 | |
| ForgettingSelection Ratio=30%, Backbone=ResNet-502026.05 | 28.7 | |
| Self-sup. proto.Selection Ratio=30%, Backbone=ResNet-502026.05 | 27.7 | |
| EL2NSelection Ratio=30%, Backbone=ResNet-502026.05 | 26.6 |