Question Answering on Evaluation Suite Zero-shot
54.3Accuracy (Zero-shot)LLaMA3.2-3.2B
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA3.2-3.2BPrune%=0%, Number of Parameters=3.2B, Zero-shot evaluation=true2026.03 | 54.3 | |
| HFPrunePrune%=20%, Number of Parameters=2.56B, Zero-shot evaluation=true2026.03 | 54.07 | |
| SDMPrunePrune%=20%, Number of Parameters=2.56B, Zero-shot evaluation=true2026.03 | 53.37 | |
| HFPrunePrune%=30%, Number of Parameters=2.25B, Zero-shot evaluation=true2026.03 | 52.28 | |
| LLMPrunerPrune%=20%, Number of Parameters=2.56B, Zero-shot evaluation=true2026.03 | 52.24 | |
| SDMPrunePrune%=30%, Number of Parameters=2.25B, Zero-shot evaluation=true2026.03 | 51.03 | |
| LoRAPrunePrune%=20%, Number of Parameters=2.57B, Zero-shot evaluation=true2026.03 | 50.3 | |
| LLMPrunerPrune%=30%, Number of Parameters=2.25B, Zero-shot evaluation=true2026.03 | 48.68 | |
| LoRAPrunePrune%=30%, Number of Parameters=2.25B, Zero-shot evaluation=true2026.03 | 48.36 |