Image Classification on ImageNet 1k (val) (Accuracy & Layer Speed-up)
0.8255Top-1 AccuracyExact
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ExactAttention Algorithm=Exact, Backbone=T2T-ViT2026.02 | 0.8255 | 1 | 1 | |
| WILDCATAttention Algorithm=WILDCAT, Backbone=T2T-ViT2026.02 | 0.8218 | 11.6 | 2.77 | |
| ThinformerAttention Algorithm=Thinformer, Backbone=T2T-ViT2026.02 | 0.8216 | 8.84 | 2.61 | |
| ScatterBrainAttention Algorithm=ScatterBrain, Backbone=T2T-ViT2026.02 | 0.8205 | 2.65 | 0.77 | |
| KDEformerAttention Algorithm=KDEformer, Backbone=T2T-ViT2026.02 | 0.8204 | 3.28 | 0.49 | |
| ReformerAttention Algorithm=Reformer, Backbone=T2T-ViT2026.02 | 0.8147 | 2.35 | 0.92 | |
| PerformerAttention Algorithm=Performer, Backbone=T2T-ViT2026.02 | 0.8091 | 7.29 | 1.82 |