Reasoning on 7-Benchmark Suite (ARC-E, ARC-C, HellaSwag, WinoGrande, PIQA, BoolQ, OBQA) (test)
68.77AccuracyLATMiX-LU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LATMiX-LUFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 68.77 | 96.58 | |
| LATMiX-LUFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 68.66 | 98.24 | |
| MR-GPTQFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 68.59 | 96.45 | |
| LATMiX-QRFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 68.37 | 96.02 | |
| SpinQuantFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 68.23 | 95.65 | |
| MR-GPTQFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 68.18 | 95.87 | |
| GPTQFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 68.11 | 95.7 | |
| LATMiX-QRFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 68.08 | 97.26 | |
| SpinQuantFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 67.81 | 95.39 | |
| FlatQuantFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 67.8 | 94.92 | |
| LATMiX-LUFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 67.75 | 94.9 | |
| QuaRotFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 67.64 | 94.95 | |
| MR-GPTQFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 67.57 | 96.51 | |
| LATMiX-QRFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 67.52 | 94.47 | |
| QuaRotFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 67.12 | 94.24 | |
| LATMiX-LUFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 67.04 | 95.77 | |
| SpinQuantFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 66.96 | 95.74 | |
| FlatQuantFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 66.89 | 95.34 | |
| RTNFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 66.84 | 93.77 | |
| LATMiX-QRFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 66.64 | 95.09 | |
| QuaRotFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 66.47 | 94.91 | |
| MR-GPTQFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 66.24 | 94.51 | |
| FlatQuantFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 66.04 | 92.35 | |
| FlatQuantFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 65.8 | 93.76 | |
| GPTQFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 65.68 | 93.77 | |
| QuaRotFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 65.6 | 93.42 | |
| SpinQuantFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 65.47 | 93.51 | |
| RTNFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 64.25 | 89.81 | |
| LATMiX-QRFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 64.03 | 95.33 | |
| LATMiX-LUFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 63.74 | 95.03 | |
| RTNFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 62.96 | 89.69 | |
| QuaRot-RTNFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 62.94 | 88.11 | |
| LATMiX-QRFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 62.74 | 93.49 | |
| GPTQFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 62.61 | 93.13 | |
| LATMiX-LUFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 62.54 | 93.35 | |
| FlatQuantFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 62.46 | 92.96 | |
| LATMiX-LUFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 62.25 | 97.75 | |
| GPTQFormat=MXINT4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 62.08 | 86.82 | |
| GPTQFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 62.08 | 88.4 | |
| MR-GPTQFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 62.05 | 92.02 | |
| QuaRot-RTNFormat=MXFP4, Model=Qwen3-8B, Zero-shot=true2026.02 | 61.91 | 87.86 | |
| SpinQuantFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 61.85 | 92.04 | |
| MR-GPTQFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 61.65 | 91.64 | |
| RTNFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 61.6 | 91.84 | |
| LATMiX-QRFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 61.54 | 96.3 | |
| FlatQuantFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 61.5 | 91.5 | |
| QuaRotFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 61.31 | 91 | |
| LATMiX-LUFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 61.1 | 95.46 | |
| MR-GPTQFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 60.89 | 95.37 | |
| MR-GPTQFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 60.82 | 95.34 | |
| FlatQuantFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 60.55 | 94.73 | |
| SpinQuantFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 60.14 | 93.89 | |
| SpinQuantFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 60.14 | 90.18 | |
| QuaRotFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 59.9 | 93.98 | |
| LATMiX-QRFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 59.77 | 93.21 | |
| QuaRot-RTNFormat=MXFP4, Model=Qwen3-4B, Zero-shot=true2026.02 | 59.74 | 88.66 | |
| QuaRotFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 59.6 | 88.42 | |
| GPTQFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 59.54 | 92.97 | |
| GPTQFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 59.25 | 92.72 | |
| QuaRot-RTNFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 59.24 | 84.01 | |
| RTNFormat=MXINT4, Model=Qwen3-8B, Zero-shot=true2026.02 | 59.17 | 84.23 | |
| RTNFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 58.85 | 91.76 | |
| QuaRotFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 58.63 | 91.76 | |
| FlatQuantFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 58.31 | 90.77 | |
| QuaRot-RTNFormat=MXFP4, Model=Llama3.1-8B-Instruct, Zero-shot=true2026.02 | 57.52 | 80.46 | |
| GPTQFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 57 | 85.78 | |
| LATMiX-LUFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 56.91 | 94.67 | |
| LATMiX-QRFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 56.31 | 93.56 | |
| SpinQuantFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 56.01 | 87.41 | |
| QuaRot-RTNFormat=MXFP4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 55.15 | 86 | |
| LATMiX-LUFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 54.86 | 90.77 | |
| FlatQuantFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 54.85 | 90.98 | |
| LATMiX-QRFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 54.84 | 91.13 | |
| RTNFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 54.58 | 85.45 | |
| LATMiX-LUFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 54.18 | 94.05 | |
| SpinQuantFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 54.14 | 89.99 | |
| SpinQuantFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 53.53 | 88.55 | |
| LATMiX-LUFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 53.16 | 92.4 | |
| FlatQuantFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 53.12 | 88.56 | |
| LATMiX-QRFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 52.99 | 92.17 | |
| MR-GPTQFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 52.79 | 87.98 | |
| QuaRotFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 52.71 | 88.11 | |
| GPTQFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 52.68 | 87.56 | |
| QuaRot-RTNFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 52.64 | 78.21 | |
| MR-GPTQFormat=MXFP4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 52.59 | 87.34 | |
| MR-GPTQFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 52.53 | 90.89 | |
| QuaRotFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 52.47 | 91.09 | |
| FlatQuantFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 52.45 | 90.54 | |
| LATMiX-QRFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 51.84 | 90.38 | |
| SpinQuantFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 51.48 | 89.2 | |
| GPTQFormat=MXFP4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 51.42 | 89.03 | |
| QuaRot-RTNFormat=MXINT4, Model=Llama3.2-3B-Instruct, Zero-shot=true2026.02 | 51.4 | 79.71 | |
| MR-GPTQFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 51.37 | 89.08 | |
| RTNFormat=MXINT4, Model=Qwen3-4B, Zero-shot=true2026.02 | 51.06 | 76.47 | |
| FlatQuantFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 50.34 | 87.25 | |
| QuaRotFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 49.9 | 86.3 | |
| QuaRotFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 49.38 | 81.98 | |
| GPTQFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 49.06 | 85 | |
| GPTQFormat=MXINT4, Model=Qwen3-1.7B, Zero-shot=true2026.02 | 48.47 | 80.42 | |
| SpinQuantFormat=MXINT4, Model=Llama3.2-1B, Zero-shot=true2026.02 | 48.28 | 83.7 |