Image Classification on ImageNet (Efficiency and Early Exit Metrics)
7.18Average Exit Layer (Standard)DeiT (FP32) LGViT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeiT (FP32) LGViTBackbone=DeiT, Bits (W/A)=FP32, Early Exiting (EE) Method=LGViT2026.05 | 7.18 | 6.19 | 17,200,000,000,000 | 18,700,000,000,000 | 81.7 | |
| DeiT (MP4/4) MAQEEBackbone=DeiT, Bits (W/A)=MP4/4, Early Exiting (EE) Method=MAQEE2026.05 | 7.59 | 7.92 | 310,000,000,000 | 301,000,000,000 | 78.57 | |
| DeiT (FP32) ViT-EEBackbone=DeiT, Bits (W/A)=FP32, Early Exiting (EE) Method=ViT-EE2026.05 | 8.15 | 9.59 | 21,900,000,000,000 | 19,700,000,000,000 | 80.51 | |
| DeiT (MP4/4) MPTQ + LGViTBackbone=DeiT, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=LGViT2026.05 | 8.86 | 12 | 409,000,000,000 | 334,000,000,000 | 73.58 | |
| DeiT (FP4/4) ERQ + LGViTBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=LGViT2026.05 | 9.09 | — | — | 337,000,000,000 | 71.32 | |
| DeiT (FP4/4) RepQ + LGViTBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=LGViT2026.05 | 10.03 | — | — | 356,000,000,000 | 69.31 | |
| DeiT (MP4/4) MPTQ + ViT-EEBackbone=DeiT, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=ViT-EE2026.05 | 10.56 | 11.8 | 394,000,000,000 | 365,000,000,000 | 76.15 | |
| DeiT (FP4/4) ERQ + ViT-EEBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=ViT-EE2026.05 | 10.86 | 11.79 | 391,000,000,000 | 372,000,000,000 | 77.59 | |
| DeiT (FP4/4) RepQ + ViT-EEBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=ViT-EE2026.05 | 11.42 | — | — | 385,000,000,000 | 70.58 | |
| DeiT (FP32) BaselineBackbone=DeiT, Bits (W/A)=FP322026.05 | 12 | — | — | 18,000,000,000,000 | 83.1 | |
| ViT-L (FP32) LGViTBackbone=ViT-L, Bits (W/A)=FP32, Early Exiting (EE) Method=LGViT2026.05 | 12.52 | 9.95 | 26,900,000,000,000 | 33,800,000,000,000 | 82.02 | |
| ViT-L (FP4/4) RepQ + LGViTBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=LGViT2026.05 | 15.76 | — | — | 818,000,000,000 | 74.02 | |
| ViT-L (FP32) ViT-EEBackbone=ViT-L, Bits (W/A)=FP32, Early Exiting (EE) Method=ViT-EE2026.05 | 16.01 | 12.43 | 33,600,000,000,000 | 43,700,000,000,000 | 82.86 | |
| ViT-L (MP4/4) MPTQ + LGViTBackbone=ViT-L, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=LGViT2026.05 | 17.1 | 21.32 | 1,010,000,000,000 | 853,000,000,000 | 75.12 | |
| ViT-L (FP4/4) ERQ + LGViTBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=LGViT2026.05 | 17.53 | 22.2 | 1,080,000,000,000 | 895,000,000,000 | 76.52 | |
| ViT-L (MP4/4) MAQEEBackbone=ViT-L, Bits (W/A)=MP4/4, Early Exiting (EE) Method=MAQEE2026.05 | 18.64 | 12.39 | 632,000,000,000 | 915,000,000,000 | 80.29 | |
| ViT-L (FP4/4) RepQ + ViT-EEBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=ViT-EE2026.05 | 19.95 | — | — | 981,000,000,000 | 76.62 | |
| ViT-L (MP4/4) MPTQ + ViT-EEBackbone=ViT-L, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=ViT-EE2026.05 | 21.33 | — | — | 1,040,000,000,000 | 75.44 | |
| ViT-L (FP4/4) ERQ + ViT-EEBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=ViT-EE2026.05 | 21.53 | — | — | 1,050,000,000,000 | 58.89 | |
| ViT-L (FP32) BaselineBackbone=ViT-L, Bits (W/A)=FP322026.05 | 24 | — | — | 63,100,000,000,000 | 85.3 |