Image Classification on ImageNet-1K (Recovery Metrics)
84.83Top-1 Recovered AccuracySTARFISH
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| STARFISHModel=DeiT3-H, Dense Acc.=84.97, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=83.23, Calib. Size=9,0002026.05 | 84.83 | 99.84 | 0.75 | |
| STARFISHModel=DeiT3-L, Dense Acc.=84.58, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=82.97, Calib. Size=7,0002026.05 | 84.44 | 99.83 | 0.99 | |
| STARFISHModel=DeiT3-H, Dense Acc.=84.97, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=81.79, Calib. Size=9,0002026.05 | 84.4 | 99.33 | 0.82 | |
| CORPModel=DeiT3-H, Dense Acc.=84.97, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=83.232026.05 | 84.2 | 99.09 | — | |
| STARFISHModel=DeiT3-H, Dense Acc.=84.97, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=78.27, Calib. Size=9,0002026.05 | 84.06 | 98.93 | 1.48 | |
| CORPModel=DeiT3-H, Dense Acc.=84.97, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=81.792026.05 | 83.7 | 98.51 | — | |
| CORPModel=DeiT3-L, Dense Acc.=84.58, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=82.972026.05 | 83.6 | 98.84 | — | |
| STARFISHModel=DeiT3-L, Dense Acc.=84.58, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=77.81, Calib. Size=7,0002026.05 | 83.22 | 98.39 | 2.74 | |
| STARFISHModel=ViT/L-16, Dense Acc.=84.20, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=QKV, Pruned Acc.=75.40, Calib. Size=7,0002026.05 | 82.96 | 98.53 | 2.32 | |
| CORPModel=DeiT3-H, Dense Acc.=84.97, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=78.272026.05 | 82.8 | 97.45 | — | |
| STARFISHModel=DeiT3-L, Dense Acc.=84.58, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=72.09, Calib. Size=7,0002026.05 | 82.69 | 97.77 | 3.89 | |
| STARFISHModel=DeiT-B, Dense Acc.=81.73, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=73.40, Calib. Size=5,0002026.05 | 81.51 | 99.73 | 0.87 | |
| SNOWSModel=ViT/L-16, Dense Acc.=84.20, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=QKV, Pruned Acc.=75.40, Calib. Size=20,0002026.05 | 81.01 | 96.21 | — | |
| CORPModel=DeiT3-L, Dense Acc.=84.58, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=77.812026.05 | 80.9 | 95.65 | — | |
| CORPModel=DeiT-B, Dense Acc.=81.73, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=73.402026.05 | 80.8 | 98.86 | — | |
| STARFISHModel=ViT/B-16, Dense Acc.=80.40, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=QKV, Pruned Acc.=78.92, Calib. Size=5,0002026.05 | 80.21 | 99.76 | 0.94 | |
| SNOWSModel=ViT/B-16, Dense Acc.=80.40, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=QKV, Pruned Acc.=78.92, Calib. Size=5,0002026.05 | 79.45 | 98.82 | — | |
| CORPModel=DeiT3-L, Dense Acc.=84.58, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=72.092026.05 | 79.4 | 93.88 | — | |
| STARFISHModel=DeiT-S, Dense Acc.=79.72, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=54.14, Calib. Size=2,5002026.05 | 79.14 | 99.27 | 8.33 | |
| STARFISHModel=ViT/B-16, Dense Acc.=80.40, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=QKV+Out+MLP, Pruned Acc.=70.86, Calib. Size=5,0002026.05 | 79.07 | 98.35 | 3.11 | |
| SNOWSModel=ViT/B-16, Dense Acc.=80.40, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=QKV+Out+MLP, Pruned Acc.=70.86, Calib. Size=5,0002026.05 | 76.57 | 95.24 | — | |
| STARFISHModel=DeiT-B, Dense Acc.=81.73, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=54.56, Calib. Size=5,0002026.05 | 75.91 | 92.88 | 8.86 | |
| STARFISHModel=DeiT-B, Dense Acc.=81.73, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=31.19, Calib. Size=5,0002026.05 | 75.77 | 92.71 | 10.73 | |
| STARFISHModel=DeiT-S, Dense Acc.=79.72, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=45.51, Calib. Size=2,5002026.05 | 72.54 | 90.99 | 8.39 | |
| CORPModel=DeiT-S, Dense Acc.=79.72, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=54.142026.05 | 72.5 | 90.94 | — | |
| STARFISHModel=ViT/L-16, Dense Acc.=84.20, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=MLP, Pruned Acc.=0.20, Calib. Size=7,0002026.05 | 72.46 | 86.06 | 3.27 | |
| STARFISHModel=DeiT-S, Dense Acc.=79.72, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=17.32, Calib. Size=2,5002026.05 | 71.59 | 89.8 | 20.18 | |
| STARFISHModel=DeiT-T, Dense Acc.=72.01, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=62.31, Calib. Size=1,0002026.05 | 70.99 | 98.58 | 9.43 | |
| SNOWSModel=ViT/L-16, Dense Acc.=84.20, Sparsity Type=2:4 semi-structured sparsity, Pruning Scope=MLP, Pruned Acc.=0.20, Calib. Size=20,0002026.05 | 69.71 | 82.79 | — | |
| CORPModel=DeiT-B, Dense Acc.=81.73, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=54.562026.05 | 68.67 | 84.02 | — | |
| CORPModel=DeiT-B, Dense Acc.=81.73, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=31.192026.05 | 67 | 81.98 | — | |
| CORPModel=DeiT-S, Dense Acc.=79.72, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=45.512026.05 | 65.85 | 82.6 | — | |
| CORPModel=DeiT-T, Dense Acc.=72.01, Sparsity Type=0.5 structured sparsity, Pruning Scope=QK, Pruned Acc.=62.312026.05 | 64.2 | 89.15 | — | |
| STARFISHModel=DeiT-T, Dense Acc.=72.01, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=10.93, Calib. Size=1,0002026.05 | 60.77 | 84.39 | 10.51 | |
| STARFISHModel=DeiT-T, Dense Acc.=72.01, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=7.57, Calib. Size=1,0002026.05 | 59.01 | 81.95 | 31.54 | |
| CORPModel=DeiT-S, Dense Acc.=79.72, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=17.322026.05 | 55.5 | 69.62 | — | |
| CORPModel=DeiT-T, Dense Acc.=72.01, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP, Pruned Acc.=10.932026.05 | 53.2 | 73.88 | — | |
| CORPModel=DeiT-T, Dense Acc.=72.01, Sparsity Type=0.5 structured sparsity, Pruning Scope=MLP+QK, Pruned Acc.=7.572026.05 | 36.3 | 50.41 | — |