Image Classification on CIFAR-10 (full) (Top-1 Accuracy)
98.7Top-1 AccLoRA (r=4)
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRA (r=4)Model Architecture=ViT-L, # Parameters=197K2026.04 | 98.7 | |
| LoRA (r=2)Model Architecture=ViT-L, # Parameters=98K2026.04 | 98.7 | |
| SOLAR r=4(4→1.6)Model Architecture=ViT-L, # Parameters=82K2026.04 | 98.5 | |
| LoRA (r=4)Model Architecture=ViT-B, # Parameters=74K2026.04 | 98.3 | |
| SOLAR r=4(4→1.6)Model Architecture=ViT-B, # Parameters=41K2026.04 | 98.3 | |
| SOLAR r=2(1→0.3)Model Architecture=ViT-L, # Parameters=50K2026.04 | 98.2 | |
| NOLAModel Architecture=ViT-L, # Parameters=96K2026.04 | 97.4 | |
| GLMCBackbone=ResNet-502023.05 | 97.23 | |
| SOLAR NOLA(4→1.2)Model Architecture=ViT-L, # Parameters=64K2026.04 | 97 | |
| SupConBackbone=ResNet-502023.05 | 96 | |
| MixUpBackbone=ResNet-502023.05 | 95.95 | |
| CutMixBackbone=ResNet-502023.05 | 95.41 | |
| vanillaBackbone=ResNet-502023.05 | 94.85 | |
| NOLAModel Architecture=ViT-B, # Parameters=48K2026.04 | 94.7 | |
| Full-FTModel Architecture=ViT-B, # Parameters=86M2026.04 | 94.6 | |
| SOLAR NOLA(4→1.2)Model Architecture=ViT-B, # Parameters=32K2026.04 | 94.5 | |
| Full-FTModel Architecture=ViT-L, # Parameters=303M2026.04 | 94.1 | |
| Linear projectionAdaptation=Backprop, Inference Compute=O(d_x^2), Inference Memory=4 MB, Learn Cost GPU Secs=780 s2026.05 | 88.3 | |
| FAASTAdaptation=Fast weights, Inference Compute=O(d_x^2), Inference Memory=4 MB, Learn Cost GPU Secs=2.1 s (-94.7%)2026.05 | 86.7 | |
| Full FinetuningAdaptation=Backprop, Inference Compute=O(d_x^2), Inference Memory=4 MB, Learn Cost GPU Secs=1,603 s2026.05 | 85.4 | |
| k-NN MemoryAdaptation=Memory, Inference Compute=O(N d_x), Inference Memory=80 MB, Learn Cost GPU Secs=41 s2026.05 | 82.7 | |
| Softmax MemoryAdaptation=Memory, Inference Compute=O(N d_x), Inference Memory=80 MB2026.05 | 80.5 | |
| CLIPAdaptation=No adapt, Inference Compute=O(d_x), Inference Memory=0 MB2026.05 | 70.3 | |
| DOLPHINM=152026.02 | 28.32 | |
| DOLPHIN + CLIPPER_TM=152026.02 | 25.71 | |
| DOLPHIN + CLIPPER_FM=152026.02 | 22.15 | |
| DOLPHIN + CLIPPER_TM=302026.02 | 17.27 | |
| DOLPHINM=302026.02 | 15.59 | |
| DOLPHIN + CLIPPER_FM=302026.02 | 15.42 |