Zero-shot Evaluation on 0-shot
71.75AccuracyDense
Evaluation results
| Method | Links | |
|---|---|---|
| DenseModel=14B-Base2026.05 | 71.75 | |
| DenseModel=32B2026.05 | 71.49 | |
| ADMM-QModel=14B-Base, Weight Bits=W42026.05 | 71.07 | |
| GPTQModel=14B-Base, Weight Bits=W42026.05 | 70.76 | |
| AWQModel=14B-Base, Weight Bits=W42026.05 | 69.82 | |
| DenseModel=8B-Base2026.05 | 69.07 | |
| DenseModel=4B-Base2026.05 | 66.72 | |
| DenseModel=1.7B-Base2026.05 | 62.54 | |
| AWQModel=1.7B-Base, Weight Bits=W42026.05 | 60.19 | |
| ADMM-QModel=1.7B-Base, Weight Bits=W42026.05 | 58.34 | |
| ADMM-QModel=8B-Base, Weight Bits=W32026.05 | 57.8 | |
| GPTQModel=1.7B-Base, Weight Bits=W42026.05 | 56.58 | |
| ADMM-QModel=32B, Weight Bits=W22026.05 | 55.65 | |
| GPTQModel=8B-Base, Weight Bits=W32026.05 | 54.43 | |
| GPTQModel=32B, Weight Bits=W22026.05 | 52.77 | |
| AWQModel=8B-Base, Weight Bits=W32026.05 | 51.08 | |
| AWQModel=32B, Weight Bits=W22026.05 | 36.57 |