Image Classification on Flowers-102 (Top-1 and Top-5)
98.4Top-1 AccuracyDeiT-Base
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DeiT-BaseParams (M)=86.5, FLOPs (G)=17.56, Structured Compression=false, Fine-tuning=true2025.05 | 98.4 | — | |
| AttnScale=Base, Params (M)=86.52026.05 | 98.4 | — | |
| DeiT-SmallParams (M)=22.1, FLOPs (G)=4.60, Structured Compression=false, Fine-tuning=true2025.05 | 98.1 | — | |
| BiMambaScale=Tiny, Params (M)=7.72026.05 | 98.1 | — | |
| AttnScale=Small, Params (M)=22.92026.05 | 98.1 | — | |
| BiMambaScale=Small, Params (M)=26.92026.05 | 98.1 | — | |
| BiMambaScale=Base, Params (M)=89.92026.05 | 98.1 | — | |
| FAR-TinyParams (M)=7.5, FLOPs (G)=1.45, Structured Compression=false, Fine-tuning=true2025.05 | 97.9 | — | |
| FAR-SmallParams (M)=23.9, FLOPs (G)=4.82, Structured Compression=false, Fine-tuning=true2025.05 | 97.9 | — | |
| FAR-BaseParams (M)=83.2, FLOPs (G)=17.31, Structured Compression=false, Fine-tuning=true2025.05 | 97.9 | — | |
| BiLSTMScale=Tiny, Params (M)=7.72026.05 | 97.9 | — | |
| BiLSTMScale=Small, Params (M)=23.92026.05 | 97.9 | — | |
| BiLSTMScale=Base, Params (M)=83.22026.05 | 97.9 | — | |
| SCOTT-12/16Architecture=SCOTT-12/16, Params=22 M, Evaluation Protocol=Frozen evaluation on top of MIM-JEPA pretraining, Training Duration=1200 epochs2025.02 | 97.7 | 99.2 | |
| DeiT-TinyParams (M)=5.7, FLOPs (G)=1.25, Structured Compression=false, Fine-tuning=true2025.05 | 97.4 | — | |
| AttnScale=Tiny, Params (M)=5.72026.05 | 97.4 | — | |
| SCOTT-12/16Architecture=SCOTT-12/16, Params=22 M, Evaluation Protocol=Frozen evaluation on top of MIM-JEPA pretraining2025.02 | 97.1 | 99.1 | |
| SCOTT-7/16Architecture=SCOTT-7/16, Params=14 M, Evaluation Protocol=Frozen evaluation on top of MIM-JEPA pretraining, Training Duration=1200 epochs2025.02 | 96.9 | 99.3 | |
| FAR-Tiny (Pruned)Params (M)=5.7, FLOPs (G)=1.08, Structured Compression=true, Fine-tuning=true2025.05 | 96.9 | — | |
| FAR-Small (Pruned)Params (M)=20.3, FLOPs (G)=3.90, Structured Compression=true, Fine-tuning=true2025.05 | 96.4 | — | |
| FAR-Base (Pruned)Params (M)=73.0, FLOPs (G)=14.80, Structured Compression=true, Fine-tuning=true2025.05 | 96.2 | — | |
| SCOTT-7/16Architecture=SCOTT-7/16, Params=14 M, Evaluation Protocol=Frozen evaluation on top of MIM-JEPA pretraining2025.02 | 95.7 | 99.1 | |
| SCOTT-12/16Architecture=SCOTT-12/16, Params=22 M, Evaluation Protocol=Supervised learning from scratch2025.02 | 79.1 | 91.9 | |
| SCOTT-7/16Architecture=SCOTT-7/16, Params=14 M, Evaluation Protocol=Supervised learning from scratch2025.02 | 79 | 92.2 | |
| ViT-12/16Architecture=ViT-12/16, Params=22 M, Evaluation Protocol=Supervised learning from scratch2025.02 | 71.1 | 87.3 |