Question Answering on Commonsense QA (QA-avg)
61.67QA-avg ScoreBF16
Evaluation results
| Method | Links | |
|---|---|---|
| BF16Quantization Bits=None, Backbone Model=LLaMA-2-7B2024.02 | 61.67 | |
| BitDistillerQuantization Bits=2, Group Size (g)=128, Backbone Model=LLaMA-2-7B2024.02 | 54.17 | |
| QuIP#Quantization Bits=2, Group Size (g)=128, Backbone Model=LLaMA-2-7B2024.02 | 52.4 | |
| QuIPQuantization Bits=2, Group Size (g)=128, Backbone Model=LLaMA-2-7B2024.02 | 38.19 |