List your company

Commonsense Question Answering on CSQA Suite (Zero-Shot CS170K)

67.78Average AccuracyQLoRA
63.98464.969565.95566.9405Feb 18, 2025

Evaluation results

MethodLinks
QLoRALLMs branch bits=4-16-16, low-rank branch bits=16-16-16, Rank=64, Zero-shot=true2025.0267.7851.7978.8681.2875.774679.9853.8975.37
GSQ-TuningLLMs branch bits=4-8-8, low-rank branch bits=8-8-8, Rank=64, Zero-shot=true2025.0267.7351.7978.3782.3275.7446.279.2753.1275.06
GSQ-TuningLLMs branch bits=4-6-6, low-rank branch bits=6-6-6, Rank=64, Zero-shot=true2025.0267.5650.7777.7482.2375.0747.479.653.5874.11
LLaMA2-7BLLMs branch bits=16-16-None, low-rank branch bits=w/o, Rank=64, Zero-shot=true2025.0264.1346.2574.6277.6876.0144.279.1146.1169.06