Common-sense Reasoning on 5 common-sense reasoning tasks Llama-2-13B
67.81AccuracyFP16
Evaluation results
| Method | Links | |
|---|---|---|
| FP16Bits=16, Group=-, Evaluation Protocol=Zero-shot2024.07 | 67.81 | |
| EfficientQATBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 67.28 | |
| AutoRoundBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 66.68 | |
| QuIP#Bits=3, Group=-, Evaluation Protocol=Zero-shot2024.07 | 66.26 | |
| GPTQBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 66.18 | |
| OmniQBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 66.18 | |
| AWQBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 66.14 | |
| RTNBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 65.77 | |
| EfficientQATBits=2, Group=64, Evaluation Protocol=Zero-shot2024.07 | 64.48 | |
| QuIP#Bits=2, Group=-, Evaluation Protocol=Zero-shot2024.07 | 64.44 | |
| EfficientQATBits=2, Group=128, Evaluation Protocol=Zero-shot2024.07 | 63.88 | |
| AQLMBits=2, Group=2x8, Evaluation Protocol=Zero-shot2024.07 | 62.22 | |
| DB-LLMBits=2, Group=64, Evaluation Protocol=Zero-shot2024.07 | 61.61 | |
| AutoRoundBits=2, Group=128, Evaluation Protocol=Zero-shot2024.07 | 60.72 | |
| OmniQBits=2, Group=128, Evaluation Protocol=Zero-shot2024.07 | 53.56 |