Commonsense Question Answering on PIQA (Accuracy)
79.49PIQA AccuracyLlama-3.1-8B-Instruct
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3.1-8B-InstructModel=Llama-3.1-8B-Instruct, Sparsity=Dense2026.06 | 79.49 | |
| DeepSeek-7B-chatModel=DeepSeek-7B-chat, Sparsity=Dense2026.06 | 77.64 | |
| FP16Bits=-, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 76.93 | |
| Llama-3.2-3B-InstructModel=Llama-3.2-3B-Instruct, Sparsity=Dense2026.06 | 75.63 | |
| Qwen2.5-7B-InstructModel=Qwen2.5-7B-Instruct, Sparsity=Dense2026.06 | 73.5 | |
| LBLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 70.97 | |
| Qwen3-4B-InstructModel=Qwen3-4B-Instruct, Sparsity=Dense2026.06 | 69.7 | |
| SUBFITModel=Llama-3.1-8B-Instruct, Sparsity=25%2026.06 | 69.48 | |
| SUBFITModel=Qwen2.5-7B-Instruct, Sparsity=25%2026.06 | 69.26 | |
| BWABits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 68.72 | |
| CBQBits=W4A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 68.25 | |
| SUBFITModel=Llama-3.2-3B-Instruct, Sparsity=25%2026.06 | 65.51 | |
| SUBFITModel=DeepSeek-7B-chat, Sparsity=25%2026.06 | 65.02 | |
| ARB-LLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 63.82 | |
| SUBFITModel=Qwen3-4B-Instruct, Sparsity=25%2026.06 | 55.01 | |
| QuaRotBits=W2A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 54.41 | |
| BiLLMBits=W(1+1)A4, Backbone=LLAMA-2-7B, Zero-shot=true2026.04 | 50.05 |