List your company

Science Question Answering on ARC Challenge (Accuracy and Delta)

39.75AccuracyZipCal
37.940438.410238.8839.3498Mar 17, 2026

Evaluation results

MethodLinks
ZipCalModel=Llama-3.1-8B-Instruct, Compression Method=2SSP, Compression Setting (Sparsity/Bit-width)=25%2026.0339.750.04
ZipCalModel=gemma-2-9b-it, Calibration Category=Mean2026.0338.9-0.9
ZipCalModel=Llama-3.1-8B-Instruct, Calibration Category=Mean2026.0338.01-1.7