List your company

Question Answering on OpenBookQA (Accuracy, Runtime, and Delta)

45.4AccuracyCOLA
45.015245.115145.21545.3149Mar 17, 2026

Evaluation results

MethodLinks
COLAModel=gemma-2-9b-it, Calibration Category=KnowTran, Quantization=GPTQ W4A162026.0345.41,500—
ZipCalModel=gemma-2-9b-it, Calibration Category=Mean, Quantization=GPTQ W4A162026.0345.0310.70.3