List your company

Question Answering on ARC Challenge (Accuracy and Calibration Runtime)

52.14AccuracyZipCal
51.952852.001452.0552.0986Mar 17, 2026

Evaluation results

MethodLinks
ZipCalModel=gemma-2-9b-it, Calibration Category=Mean, Quantization=GPTQ W4A162026.0352.1410.763
ZipCalModel=Llama-3.1-8B-Instruct, Calibration Category=KnowTran, Quantization=GPTQ W4A162026.0351.9614.5—