List your company
ResearchFormerly WizWand

Image Classification on CIFAR-10 (full) (Top-1 Accuracy)

98.7Top-1 AccLoRA (r=4)
12.088834.574457.0679.5456May 15, 2023Nov 12, 2023May 11, 2024Nov 8, 2024May 8, 2025Nov 5, 2025May 6, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LoRA (r=4)Model Architecture=ViT-L, # Parameters=197K2026.0498.7
LoRA (r=2)Model Architecture=ViT-L, # Parameters=98K2026.0498.7
SOLAR r=4(4→1.6)Model Architecture=ViT-L, # Parameters=82K2026.0498.5
LoRA (r=4)Model Architecture=ViT-B, # Parameters=74K2026.0498.3
SOLAR r=4(4→1.6)Model Architecture=ViT-B, # Parameters=41K2026.0498.3
SOLAR r=2(1→0.3)Model Architecture=ViT-L, # Parameters=50K2026.0498.2
NOLAModel Architecture=ViT-L, # Parameters=96K2026.0497.4
GLMCBackbone=ResNet-502023.0597.23
SOLAR NOLA(4→1.2)Model Architecture=ViT-L, # Parameters=64K2026.0497
SupConBackbone=ResNet-502023.0596
MixUpBackbone=ResNet-502023.0595.95
CutMixBackbone=ResNet-502023.0595.41
vanillaBackbone=ResNet-502023.0594.85
NOLAModel Architecture=ViT-B, # Parameters=48K2026.0494.7
Full-FTModel Architecture=ViT-B, # Parameters=86M2026.0494.6
SOLAR NOLA(4→1.2)Model Architecture=ViT-B, # Parameters=32K2026.0494.5
Full-FTModel Architecture=ViT-L, # Parameters=303M2026.0494.1
Linear projectionAdaptation=Backprop, Inference Compute=O(d_x^2), Inference Memory=4 MB, Learn Cost GPU Secs=780 s2026.0588.3
FAASTAdaptation=Fast weights, Inference Compute=O(d_x^2), Inference Memory=4 MB, Learn Cost GPU Secs=2.1 s (-94.7%)2026.0586.7
Full FinetuningAdaptation=Backprop, Inference Compute=O(d_x^2), Inference Memory=4 MB, Learn Cost GPU Secs=1,603 s2026.0585.4
k-NN MemoryAdaptation=Memory, Inference Compute=O(N d_x), Inference Memory=80 MB, Learn Cost GPU Secs=41 s2026.0582.7
Softmax MemoryAdaptation=Memory, Inference Compute=O(N d_x), Inference Memory=80 MB2026.0580.5
CLIPAdaptation=No adapt, Inference Compute=O(d_x), Inference Memory=0 MB2026.0570.3
DOLPHINM=152026.0228.32
DOLPHIN + CLIPPER_TM=152026.0225.71
DOLPHIN + CLIPPER_FM=152026.0222.15
DOLPHIN + CLIPPER_TM=302026.0217.27
DOLPHINM=302026.0215.59
DOLPHIN + CLIPPER_FM=302026.0215.42