Commonsense Question Answering on CSQA Suite (Zero-Shot CS170K)
67.78Average AccuracyQLoRA
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| QLoRALLMs branch bits=4-16-16, low-rank branch bits=16-16-16, Rank=64, Zero-shot=true2025.02 | 67.78 | 51.79 | 78.86 | 81.28 | 75.77 | 46 | 79.98 | 53.89 | 75.37 | |
| GSQ-TuningLLMs branch bits=4-8-8, low-rank branch bits=8-8-8, Rank=64, Zero-shot=true2025.02 | 67.73 | 51.79 | 78.37 | 82.32 | 75.74 | 46.2 | 79.27 | 53.12 | 75.06 | |
| GSQ-TuningLLMs branch bits=4-6-6, low-rank branch bits=6-6-6, Rank=64, Zero-shot=true2025.02 | 67.56 | 50.77 | 77.74 | 82.23 | 75.07 | 47.4 | 79.6 | 53.58 | 74.11 | |
| LLaMA2-7BLLMs branch bits=16-16-None, low-rank branch bits=w/o, Rank=64, Zero-shot=true2025.02 | 64.13 | 46.25 | 74.62 | 77.68 | 76.01 | 44.2 | 79.11 | 46.11 | 69.06 |