Zero-shot Evaluation on Non-reasoning tasks
70.8Accuracy (Zero-shot Non-reasoning)FP16
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FP16Quantization Format=FP162025.11 | 70.8 | — | |
| FlatQuantQuantization Format=INT4, Bit-width=W4A4, Weight Quantization Method=GPTQ2025.11 | 69.4 | — | |
| ParoQuantQuantization Format=INT4, Bit-width=W4A4, Weight Quantization Method=GPTQ2025.11 | 67.7 | — | |
| SpinQuantQuantization Format=INT4, Bit-width=W4A4, Weight Quantization Method=GPTQ2025.11 | 66.6 | — | |
| FP16Format=FP16, Quantization=None2025.11 | — | 70.8 | |
| MR-GPTQFormat=MXFP4, Quantization=W4A4, Weight Quantization=GPTQ2025.11 | — | 68.4 | |
| ParoQuantFormat=MXFP4, Quantization=W4A4, Weight Quantization=GPTQ2025.11 | — | 69.6 |