Model Evaluation Summary on Overall Aggregate
1.003Average ScoreSVDQuant
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SVDQuantBit=W8A8, Format=INT2026.02 | 1.003 | -0.3 | |
| RTNBit=W8A8, Format=INT2026.02 | 1.002 | -0.2 | |
| SmoothQuantBit=W8A8, Format=MXFP2026.02 | 1.001 | -0.1 | |
| SmoothQuantBit=W8A8, Format=HiF2026.02 | 1.001 | -0.1 | |
| SVDQuantBit=W8A8, Format=MXFP2026.02 | 1.001 | -0.1 | |
| SVDQuantBit=W8A8, Format=HiF2026.02 | 1.001 | -0.1 | |
| BF162026.02 | 1 | — | |
| RTNBit=W8A8, Format=MXFP2026.02 | 1 | 0 | |
| SmoothQuantBit=W8A8, Format=INT2026.02 | 1 | 0 | |
| RTNBit=W8A8, Format=HiF2026.02 | 0.997 | 0.3 | |
| SmoothQuantBit=W4A4, Format=NVFP2026.02 | 0.983 | 1.7 | |
| SVDQuantBit=W4A4, Format=NVFP2026.02 | 0.98 | 2 | |
| SVDQuantBit=W4A4, Format=HiF2026.02 | 0.98 | 2 | |
| SmoothQuantBit=W4A4, Format=HiF2026.02 | 0.978 | 2.2 | |
| RTNBit=W4A4, Format=NVFP2026.02 | 0.971 | 2.9 | |
| RTNBit=W4A4, Format=HiF2026.02 | 0.965 | 3.5 | |
| SVDQuantBit=W4A4, Format=MXFP2026.02 | 0.935 | 6.5 | |
| SmoothQuantBit=W4A4, Format=MXFP2026.02 | 0.926 | 7.4 | |
| RTNBit=W4A4, Format=MXFP2026.02 | 0.898 | 10.2 | |
| SVDQuantBit=W4A4, Format=INT2026.02 | 0.313 | 68.7 | |
| RTNBit=W4A4, Format=INT2026.02 | 0.277 | 72.3 | |
| SmoothQuantBit=W4A4, Format=INT2026.02 | 0.267 | 73.3 |