Zero-shot Language Understanding on Zero-shot Benchmarks
73.07Average Zero-shot AccuracyNeUQI
Evaluation Results
| Method | Links | |
|---|---|---|
| NeUQIMemory=26.36 GiB, Size=72B, Bits=32025.05 | 73.07 | |
| Qwen 2.5Memory=26.42 GiB, Size=14B, Bits=162025.05 | 71.46 | |
| NeUQIMemory=11.72 GiB, Size=32B, Bits=32025.05 | 69.95 | |
| NeUQIMemory=4.96 GiB, Size=14B, Bits=32025.05 | 69.12 | |
| Qwen 2.5Memory=13.05 GiB, Size=7B, Bits=162025.05 | 68.04 | |
| GPTQMemory=26.36 GiB, Size=72B, Bits=32025.05 | 67.3 | |
| NeUQIMemory=2.45 GiB, Size=7B, Bits=32025.05 | 65.13 | |
| Qwen 2.5Memory=5.55 GiB, Size=3B, Bits=162025.05 | 64.99 | |
| GPTQMemory=11.72 GiB, Size=32B, Bits=32025.05 | 64.38 | |
| Qwen 2.5Memory=2.62 GiB, Size=1.5B, Bits=162025.05 | 61.3 | |
| GPTQMemory=4.96 GiB, Size=14B, Bits=32025.05 | 60.26 | |
| GPTQMemory=2.45 GiB, Size=7B, Bits=32025.05 | 58.95 | |
| LLaMA3.2-1.2BPrune%=0%, #Params=1.2B2026.03 | 51.47 | |
| HFPrunePrune%=20%, #Params=0.989B2026.03 | 50.77 | |
| SDMPrunePrune%=20%, #Params=0.989B2026.03 | 48.94 | |
| HFPrunePrune%=30%, #Params=0.865B2026.03 | 48.59 | |
| LLMPrunerPrune%=20%, #Params=0.989B2026.03 | 47.39 | |
| LoRAPrunePrune%=20%, #Params=0.989B2026.03 | 47.17 | |
| SDMPrunePrune%=30%, #Params=0.865B2026.03 | 46.4 | |
| LoRAPrunePrune%=30%, #Params=0.865B2026.03 | 44.86 | |
| LLMPrunerPrune%=30%, #Params=0.865B2026.03 | 44.79 |