Commonsense Question Answering on Commonsense QA 8 datasets
66.1Average QA ScoreFull-precision
Evaluation results
| Method | Links | |
|---|---|---|
| Full-precision#Bits=16, Size (GB)=16.06, Backbone=LLaMA3-8B, Zero-shot=true2024.11 | 66.1 | |
| GPTQ + QwT#Bits=4, Size (GB)=6.80, Backbone=LLaMA3-8B, Zero-shot=true2024.11 | 65.18 | |
| GPTQ#Bits=4, Size (GB)=5.73, Backbone=LLaMA3-8B, Zero-shot=true2024.11 | 64.9 |