Image Classification on ImageNet 1k (Acc@1, kNN)
96.24Top-1 AccuracySPoT-ON-B/16
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPoT-ON-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=true, Token Budget=1962025.07 | 96.24 | 91.28 | |
| SPoT-ON-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=true, Token Budget=1962025.07 | 96.12 | 93.52 | |
| SPoT-ON-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=true, Token Budget=1002025.07 | 96.09 | 90.76 | |
| SPoT-ON-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=true, Token Budget=1962025.07 | 96.04 | 93.97 | |
| SPoT-ON-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=true, Token Budget=1002025.07 | 95.97 | 92.92 | |
| SPoT-ON-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=true, Token Budget=1002025.07 | 95.79 | 93.61 | |
| SPoT-ON-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=true, Token Budget=492025.07 | 94.87 | 87.87 | |
| SPoT-ON-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=true, Token Budget=492025.07 | 94.28 | 88.58 | |
| SPoT-ON-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=true, Token Budget=492025.07 | 94.21 | 90.11 | |
| SPoT-ON-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=true, Token Budget=252025.07 | 90.93 | 79.73 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=false, Token Budget=1962025.07 | 85.15 | 83.42 | |
| ViT-B/16Pre-training=CLS-IN21k, Prior=Patch Grid, Oracle=false, Token Budget=1962025.07 | 85.11 | 83.96 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Sobol, Oracle=false, Token Budget=1962025.07 | 84.66 | 82.62 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Salient, Oracle=true, Token Budget=1962025.07 | 84.56 | 82.59 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Center, Oracle=false, Token Budget=1962025.07 | 84.01 | 82.23 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=false, Token Budget=1962025.07 | 83.89 | 79.53 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Uniform, Oracle=false, Token Budget=1962025.07 | 83.76 | 81.85 | |
| ViT-B/16Pre-training=MAE-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=1962025.07 | 83.6 | 82.07 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Sobol, Oracle=false, Token Budget=1962025.07 | 83.51 | 79.09 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Gaussian, Oracle=false, Token Budget=1962025.07 | 83.45 | 81.48 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Center, Oracle=false, Token Budget=1962025.07 | 82.97 | 78.54 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Uniform, Oracle=false, Token Budget=1962025.07 | 82.78 | 78.21 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=false, Token Budget=1002025.07 | 82.76 | 77.24 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Gaussian, Oracle=false, Token Budget=1962025.07 | 82.55 | 77.9 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=false, Token Budget=1002025.07 | 82.2 | 80.73 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Sobol, Oracle=false, Token Budget=1002025.07 | 82.19 | 76.24 | |
| SPoT-ON-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=true, Token Budget=252025.07 | 81.7 | 70.65 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Salient, Oracle=true, Token Budget=1962025.07 | 81.64 | 79.13 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Sobol, Oracle=false, Token Budget=1002025.07 | 81.63 | 79.35 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Salient, Oracle=true, Token Budget=1002025.07 | 81.46 | 77.25 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Center, Oracle=false, Token Budget=1002025.07 | 81.06 | 75.2 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Center, Oracle=false, Token Budget=1002025.07 | 80.84 | 78.56 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=false, Token Budget=1962025.07 | 80.61 | 79.04 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Uniform, Oracle=false, Token Budget=1002025.07 | 80.53 | 74.76 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Gaussian, Oracle=false, Token Budget=1002025.07 | 80.31 | 74.52 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Sobol, Oracle=false, Token Budget=1962025.07 | 79.96 | 78.17 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Salient, Oracle=true, Token Budget=1002025.07 | 79.91 | 80.56 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Gaussian, Oracle=false, Token Budget=1002025.07 | 79.75 | 77.74 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Uniform, Oracle=false, Token Budget=1002025.07 | 79.64 | 78.03 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Salient, Oracle=true, Token Budget=1962025.07 | 79.54 | 78.03 | |
| ViT-B/16Pre-training=MAE-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=1002025.07 | 79.53 | 78.41 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Uniform, Oracle=false, Token Budget=1962025.07 | 79.38 | 77.36 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Center, Oracle=false, Token Budget=1962025.07 | 79.32 | 77.71 | |
| ViT-B/16Pre-training=CLS-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=1962025.07 | 79.14 | 77.64 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Gaussian, Oracle=false, Token Budget=1962025.07 | 79.02 | 77 | |
| ViT-B/16Pre-training=CLS-IN21k, Prior=Patch Grid, Oracle=false, Token Budget=1002025.07 | 78.75 | 78.77 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=false, Token Budget=1002025.07 | 77.58 | 76.29 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Salient, Oracle=true, Token Budget=492025.07 | 77.1 | 72.24 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=false, Token Budget=492025.07 | 76.84 | 70.02 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Sobol, Oracle=false, Token Budget=1002025.07 | 76.45 | 75.18 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Sobol, Oracle=false, Token Budget=492025.07 | 75.71 | 68.71 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Center, Oracle=false, Token Budget=1002025.07 | 75.41 | 73.63 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Center, Oracle=false, Token Budget=492025.07 | 74.63 | 67.31 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Uniform, Oracle=false, Token Budget=1002025.07 | 74.44 | 73.18 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Gaussian, Oracle=false, Token Budget=1002025.07 | 74.37 | 72.82 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Salient, Oracle=true, Token Budget=1002025.07 | 74.36 | 75.25 | |
| SPoT-ON-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=true, Token Budget=252025.07 | 73.99 | 74.42 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Uniform, Oracle=false, Token Budget=492025.07 | 73.22 | 65.85 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Salient, Oracle=true, Token Budget=492025.07 | 72.89 | 72.38 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Gaussian, Oracle=false, Token Budget=492025.07 | 72.51 | 65.59 | |
| ViT-B/16Pre-training=CLS-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=1002025.07 | 71.22 | 71.41 | |
| ViT-B/16Pre-training=MAE-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=492025.07 | 70.69 | 67.15 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=false, Token Budget=492025.07 | 70.61 | 70.29 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Center, Oracle=false, Token Budget=492025.07 | 69.22 | 68.16 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Sobol, Oracle=false, Token Budget=492025.07 | 69.02 | 68.6 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Gaussian, Oracle=false, Token Budget=492025.07 | 68.64 | 66.96 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Uniform, Oracle=false, Token Budget=492025.07 | 67.77 | 66.38 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Salient, Oracle=true, Token Budget=492025.07 | 66.32 | 66 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=false, Token Budget=492025.07 | 66.18 | 66.25 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Salient, Oracle=true, Token Budget=252025.07 | 66.13 | 60.8 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Sobol, Oracle=false, Token Budget=492025.07 | 64.42 | 63.88 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Center, Oracle=false, Token Budget=492025.07 | 63.04 | 62.65 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Center, Oracle=false, Token Budget=252025.07 | 62.83 | 55.61 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Isotropic, Oracle=false, Token Budget=252025.07 | 61.72 | 54.56 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Uniform, Oracle=false, Token Budget=492025.07 | 60.64 | 60.84 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Sobol, Oracle=false, Token Budget=252025.07 | 60.62 | 53.54 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Gaussian, Oracle=false, Token Budget=492025.07 | 60.47 | 60.23 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Gaussian, Oracle=false, Token Budget=252025.07 | 57.58 | 49.49 | |
| SPoT-B/16Pre-training=MAE-IN1k, Prior=Uniform, Oracle=false, Token Budget=252025.07 | 56.71 | 49.72 | |
| ViT-B/16Pre-training=CLS-IN21k, Prior=Patch Grid, Oracle=false, Token Budget=492025.07 | 56.29 | 57.19 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Salient, Oracle=true, Token Budget=252025.07 | 55.71 | 56.65 | |
| ViT-B/16Pre-training=MAE-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=252025.07 | 55.43 | 48.85 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Center, Oracle=false, Token Budget=252025.07 | 52.45 | 52.18 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Isotropic, Oracle=false, Token Budget=252025.07 | 46.85 | 48.19 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Gaussian, Oracle=false, Token Budget=252025.07 | 45.22 | 45.27 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Uniform, Oracle=false, Token Budget=252025.07 | 44.05 | 45.23 | |
| SPoT-B/16Pre-training=CLS-IN21k, Prior=Sobol, Oracle=false, Token Budget=252025.07 | 43.67 | 46.48 | |
| ViT-B/16Pre-training=CLS-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=492025.07 | 41.05 | 44.38 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Center, Oracle=false, Token Budget=252025.07 | 39.91 | 42.47 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Salient, Oracle=true, Token Budget=252025.07 | 39.83 | 43.72 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Isotropic, Oracle=false, Token Budget=252025.07 | 33.52 | 37.84 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Sobol, Oracle=false, Token Budget=252025.07 | 30.67 | 35.23 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Uniform, Oracle=false, Token Budget=252025.07 | 29.87 | 33.88 | |
| SPoT-B/16Pre-training=CLS-IN1k, Prior=Gaussian, Oracle=false, Token Budget=252025.07 | 29.27 | 33.07 | |
| ViT-B/16Pre-training=CLS-IN21k, Prior=Patch Grid, Oracle=false, Token Budget=252025.07 | 24.72 | 27.86 | |
| ViT-B/16Pre-training=CLS-IN1k, Prior=Patch Grid, Oracle=false, Token Budget=252025.07 | 9.24 | 12.05 |