Image Classification on ImageNet 1K (Test Loss and Accuracy)
0.834Test LossViT Base Fast-ConvNN
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ViT Base Fast-ConvNNNH=12, Candidate Selection=All, k=25, GFLOPS=34.416, # Params=86.398M2026.05 | 0.834 | 81.64 | |
| ViT Base ConvNNNH=12, Candidate Selection=All, k=16, GFLOPS=34.445, # Params=86.391M2026.05 | 0.838 | 81.6 | |
| ViT Base Fast-ConvNNNH=12, Candidate Selection=All, k=36, GFLOPS=34.416, # Params=86.407M2026.05 | 0.845 | 81.61 | |
| ViT Base ConvNNNH=12, Candidate Selection=All, k=9, GFLOPS=34.432, # Params=86.386M2026.05 | 0.855 | 81.19 | |
| ViT Base KVTNH=12, k=16, GFLOPS=35.137, # Params=86.379M2026.05 | 0.871 | 81.04 | |
| ViT Base KVTNH=12, k=25, GFLOPS=35.137, # Params=86.379M2026.05 | 0.874 | 81.28 | |
| ViT Base KVTNH=12, k=36, GFLOPS=35.137, # Params=86.379M2026.05 | 0.88 | 81.03 | |
| ViT Base KVTNH=12, k=9, GFLOPS=35.137, # Params=86.379M2026.05 | 0.883 | 80.5 | |
| ViT Base KVTNH=12, k=100, GFLOPS=35.137, # Params=86.379M2026.05 | 0.884 | 81.04 | |
| ViT Base MHANH=12, GFLOPS=35.131, # Params=86.379M2026.05 | 0.899 | 80.94 | |
| ViT Base MHANH=1, GFLOPS=35.131, # Params=86.379M2026.05 | 0.913 | 79.35 | |
| ViT Base ConvNNNH=12, Candidate Selection=Spat, k=9, r=128, GFLOPS=34.181, # Params=86.386M2026.05 | 0.931 | 79.31 | |
| ViT Base ConvNNNH=1, Candidate Selection=All, k=16, GFLOPS=34.445, # Params=86.526M2026.05 | 0.937 | 79.14 | |
| ViT Base ConvNNNH=1, Candidate Selection=All, k=9, GFLOPS=34.432, # Params=86.462M2026.05 | 0.969 | 78.2 | |
| ViT Base KVTNH=1, k=16, GFLOPS=35.131, # Params=86.379M2026.05 | 0.972 | 78.25 | |
| ViT Base KVTNH=1, k=9, GFLOPS=35.131, # Params=86.379M2026.05 | 1.02 | 76.95 | |
| ViT Base ConvNNNH=12, Candidate Selection=Rand, k=9, r=32, GFLOPS=33.833, # Params=86.386M2026.05 | 1.064 | 76.04 | |
| ViT Base ConvNNNH=1, Candidate Selection=Spat, k=9, r=128, GFLOPS=33.205, # Params=86.462M2026.05 | 1.076 | 75.86 | |
| ViT Base ConvNNNH=1, Candidate Selection=All, k=4, GFLOPS=34.423, # Params=86.416M2026.05 | 1.131 | 74.6 | |
| ViT Base KVTNH=1, k=4, GFLOPS=35.131, # Params=86.379M2026.05 | 1.182 | 73.38 | |
| ViT Base ConvNNNH=1, Candidate Selection=Rand, k=9, r=32, GFLOPS=31.497, # Params=86.462M2026.05 | 1.262 | 71.6 |