Image Classification on CIFAR-100 (Exit Layer Efficiency and Accuracy)
5.98Average Exit Layer (Standard)DeiT (MP4/4) MAQEE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeiT (MP4/4) MAQEEBackbone=DeiT, Bits (W/A)=MP4/4, Early Exiting (EE) Method=MAQEE2026.05 | 5.98 | 5.86 | 261,000,000,000 | 264,000,000,000 | 87.86 | |
| DeiT (FP32) LGViTBackbone=DeiT, Bits (W/A)=FP32, Early Exiting (EE) Method=LGViT2026.05 | 6.33 | 5.47 | 16,100,000,000,000 | 17,000,000,000,000 | 89.03 | |
| DeiT (MP4/4) MPTQ + LGViTBackbone=DeiT, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=LGViT2026.05 | 7.76 | 11.35 | 393,000,000,000 | 307,000,000,000 | 83.15 | |
| DeiT (FP32) ViT-EEBackbone=DeiT, Bits (W/A)=FP32, Early Exiting (EE) Method=ViT-EE2026.05 | 8.1 | 7.2 | 18,400,000,000,000 | 19,700,000,000,000 | 89.24 | |
| DeiT (MP4/4) MPTQ + ViT-EEBackbone=DeiT, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=ViT-EE2026.05 | 8.51 | 8.81 | 325,000,000,000 | 317,000,000,000 | 84.57 | |
| DeiT (FP4/4) ERQ + LGViTBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=LGViT2026.05 | 9 | — | — | 334,000,000,000 | 78.51 | |
| DeiT (FP4/4) ERQ + ViT-EEBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=ViT-EE2026.05 | 9.28 | 8.77 | 323,000,000,000 | 335,000,000,000 | 87.86 | |
| DeiT (FP4/4) RepQ + LGViTBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=LGViT2026.05 | 9.37 | — | — | 342,000,000,000 | 75.43 | |
| ViT-L (MP4/4) MAQEEBackbone=ViT-L, Bits (W/A)=MP4/4, Early Exiting (EE) Method=MAQEE2026.05 | 9.71 | 9.66 | 564,000,000,000 | 579,000,000,000 | 88.17 | |
| DeiT (FP4/4) RepQ + ViT-EEBackbone=DeiT, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=ViT-EE2026.05 | 9.91 | — | — | 359,000,000,000 | 84.79 | |
| ViT-L (FP32) LGViTBackbone=ViT-L, Bits (W/A)=FP32, Early Exiting (EE) Method=LGViT2026.05 | 10.85 | 8.34 | 22,600,000,000,000 | 29,300,000,000,000 | 92.53 | |
| DeiT (FP32) BaselineBackbone=DeiT, Bits (W/A)=FP322026.05 | 12 | — | — | 18,000,000,000,000 | 91.86 | |
| ViT-L (FP32) ViT-EEBackbone=ViT-L, Bits (W/A)=FP32, Early Exiting (EE) Method=ViT-EE2026.05 | 12.94 | 11.75 | 31,100,000,000,000 | 34,100,000,000,000 | 92.4 | |
| ViT-L (FP4/4) RepQ + LGViTBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=LGViT2026.05 | 20.69 | 23.94 | 1,140,000,000,000 | 1,010,000,000,000 | 85.97 | |
| ViT-L (FP4/4) ERQ + LGViTBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=LGViT2026.05 | 20.74 | 21.06 | 1,020,000,000,000 | 1,010,000,000,000 | 85.59 | |
| ViT-L (MP4/4) MPTQ + LGViTBackbone=ViT-L, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=LGViT2026.05 | 21.64 | 20.28 | 992,000,000,000 | 1,050,000,000,000 | 84.33 | |
| ViT-L (MP4/4) MPTQ + ViT-EEBackbone=ViT-L, Bits (W/A)=MP4/4, Quantization Method=MPTQ, Early Exiting (EE) Method=ViT-EE2026.05 | 21.96 | — | — | 1,060,000,000,000 | 83.31 | |
| ViT-L (FP4/4) ERQ + ViT-EEBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=ERQ, Early Exiting (EE) Method=ViT-EE2026.05 | 22.58 | — | — | 1,090,000,000,000 | 82.34 | |
| ViT-L (FP4/4) RepQ + ViT-EEBackbone=ViT-L, Bits (W/A)=FP4/4, Quantization Method=RepQ, Early Exiting (EE) Method=ViT-EE2026.05 | 23.11 | — | — | 1,120,000,000,000 | 81.31 | |
| ViT-L (FP32) BaselineBackbone=ViT-L, Bits (W/A)=FP322026.05 | 24 | — | — | 63,100,000,000,000 | 93.25 |