Zero-shot Evaluation on Reasoning tasks
70.7Reasoning AccuracyFP16
Evaluation results
| Method | Links | |
|---|---|---|
| FP16Quantization Format=FP162025.11 | 70.7 | |
| FlatQuantQuantization Format=INT4, Bit-width=W4A4, Weight Quantization Method=GPTQ2025.11 | 63.9 | |
| ParoQuantQuantization Format=INT4, Bit-width=W4A4, Weight Quantization Method=GPTQ2025.11 | 63.6 | |
| SpinQuantQuantization Format=INT4, Bit-width=W4A4, Weight Quantization Method=GPTQ2025.11 | 61.7 | |
| FP16Format=FP16, Quantization=None2025.11 | 0.707 | |
| MR-GPTQFormat=MXFP4, Quantization=W4A4, Weight Quantization=GPTQ2025.11 | 0.625 | |
| ParoQuantFormat=MXFP4, Quantization=W4A4, Weight Quantization=GPTQ2025.11 | 0.614 |