List your company
ResearchFormerly WizWand

Zero-shot Language Understanding on Zero-shot Benchmarks

73.07Average Zero-shot AccuracyNeUQI
43.658851.294458.9366.5656May 23, 2025Jul 10, 2025Aug 27, 2025Oct 15, 2025Dec 2, 2025Jan 19, 2026Mar 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
NeUQIMemory=26.36 GiB, Size=72B, Bits=32025.0573.07
Qwen 2.5Memory=26.42 GiB, Size=14B, Bits=162025.0571.46
NeUQIMemory=11.72 GiB, Size=32B, Bits=32025.0569.95
NeUQIMemory=4.96 GiB, Size=14B, Bits=32025.0569.12
Qwen 2.5Memory=13.05 GiB, Size=7B, Bits=162025.0568.04
GPTQMemory=26.36 GiB, Size=72B, Bits=32025.0567.3
NeUQIMemory=2.45 GiB, Size=7B, Bits=32025.0565.13
Qwen 2.5Memory=5.55 GiB, Size=3B, Bits=162025.0564.99
GPTQMemory=11.72 GiB, Size=32B, Bits=32025.0564.38
Qwen 2.5Memory=2.62 GiB, Size=1.5B, Bits=162025.0561.3
GPTQMemory=4.96 GiB, Size=14B, Bits=32025.0560.26
GPTQMemory=2.45 GiB, Size=7B, Bits=32025.0558.95
LLaMA3.2-1.2BPrune%=0%, #Params=1.2B2026.0351.47
HFPrunePrune%=20%, #Params=0.989B2026.0350.77
SDMPrunePrune%=20%, #Params=0.989B2026.0348.94
HFPrunePrune%=30%, #Params=0.865B2026.0348.59
LLMPrunerPrune%=20%, #Params=0.989B2026.0347.39
LoRAPrunePrune%=20%, #Params=0.989B2026.0347.17
SDMPrunePrune%=30%, #Params=0.865B2026.0346.4
LoRAPrunePrune%=30%, #Params=0.865B2026.0344.86
LLMPrunerPrune%=30%, #Params=0.865B2026.0344.79