Common-sense Reasoning on 5 common-sense reasoning tasks Llama-3-70B
75.33Average AccuracyFP16
Evaluation results
| Method | Links | |
|---|---|---|
| FP16Bits=16, Group=-, Evaluation Protocol=Zero-shot2024.07 | 75.33 | |
| EfficientQATBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 73.96 | |
| AWQBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 73.65 | |
| OmniQBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 71.9 | |
| GPTQBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 71.28 | |
| EfficientQATBits=2, Group=64, Evaluation Protocol=Zero-shot2024.07 | 67.89 | |
| EfficientQATBits=2, Group=128, Evaluation Protocol=Zero-shot2024.07 | 67.57 | |
| RTNBits=3, Group=128, Evaluation Protocol=Zero-shot2024.07 | 65.29 | |
| OmniQBits=2, Group=128, Evaluation Protocol=Zero-shot2024.07 | 60.06 |