Image Classification on ImageNet (val) (Accuracy Drop)
0.32Accuracy DropGPTQ
Evaluation Results
| Method | Links | |
|---|---|---|
| GPTQbit-width=4-bit, LayerNorm adjustment=after, Backbone=DeiT-B2025.08 | 0.32 | |
| Beaconbit-width=4-bit, Backbone=DeiT-B2025.08 | 0.34 | |
| GPTQbit-width=4-bit, LayerNorm adjustment=before, Backbone=DeiT-B2025.08 | 0.42 | |
| COMQbit-width=4-bit, Backbone=DeiT-B2025.08 | 0.59 | |
| Beaconbit-width=3-bit, Backbone=DeiT-B2025.08 | 1.05 | |
| COMQbit-width=3-bit, Backbone=DeiT-B2025.08 | 1.52 | |
| GPTQbit-width=3-bit, LayerNorm adjustment=after, Backbone=DeiT-B2025.08 | 1.56 | |
| GPTQbit-width=3-bit, LayerNorm adjustment=before, Backbone=DeiT-B2025.08 | 1.81 | |
| Beaconbit-width=2-bit, Backbone=DeiT-B2025.08 | 4.55 | |
| COMQbit-width=2-bit, Backbone=DeiT-B2025.08 | 4.85 | |
| GPTQbit-width=2-bit, LayerNorm adjustment=after, Backbone=DeiT-B2025.08 | 15.15 | |
| GPTQbit-width=2-bit, LayerNorm adjustment=before, Backbone=DeiT-B2025.08 | 20.48 |