Multitask Language Understanding on MMLU CoT
72.8MMLU (CoT)FP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Format=FP162025.09 | 72.8 | |
| RTNFormat=INT82025.09 | 72.5 | |
| GPTQFormat=INT82025.09 | 72.4 | |
| RTNFormat=FP82025.09 | 72.4 | |
| GPTQFormat=FP82025.09 | 71.8 | |
| MR-GPTQFormat=NVINT42025.09 | 69.71 | |
| GPTQ+HadFormat=NVFP2025.09 | 69.4 | |
| GPTQ+Had128Format=NVFP2025.09 | 68.9 | |
| QAT+HadFormat=NVFP2025.09 | 68.9 | |
| RTNFormat=NVFP2025.09 | 68.7 | |
| GPTQFormat=NVINT42025.09 | 68.69 | |
| GPTQFormat=NVFP2025.09 | 68.6 | |
| RTN + HTFormat=NVINT42025.09 | 68.59 | |
| RTNFormat=NVINT42025.09 | 68.56 | |
| QATFormat=NVFP2025.09 | 68.2 | |
| QAT+HadFormat=MXFP2025.09 | 67.6 | |
| GPTQ+HadFormat=MXFP2025.09 | 67.2 | |
| RTN+HadFormat=NVFP2025.09 | 67 | |
| GPTQ+Had128Format=MXFP2025.09 | 66.8 | |
| RTN+Had128Format=NVFP2025.09 | 66.6 | |
| MR-GPTQFormat=MXINT42025.09 | 65.48 | |
| QATFormat=MXFP2025.09 | 65 | |
| RTN+Had128Format=MXFP2025.09 | 64.5 | |
| GPTQFormat=MXFP2025.09 | 63.74 | |
| RTN+HadFormat=MXFP2025.09 | 62.6 | |
| RTNFormat=MXFP2025.09 | 62.2 | |
| GPTQFormat=MXINT42025.09 | 61.22 | |
| RTN + HTFormat=MXINT42025.09 | 58.44 | |
| RTNFormat=MXINT42025.09 | 55.06 |