Reasoning on Reasoning Tasks Average
68.6Average ScoreLlama-3-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3-8BBackbone=Llama-3-8B, #Bit=16.00, Zero-shot=true2025.03 | 68.6 | |
| ClusCompBackbone=Llama-3-8B, #Bit=4.13, Zero-shot=true2025.03 | 68.4 | |
| AWQBackbone=Llama-3-8B, #Bit=4.13, Zero-shot=true2025.03 | 68.2 | |
| SliM-LLMBackbone=Llama-3-8B, #Bit=4.13, Zero-shot=true2025.03 | 67.9 | |
| GPTQBackbone=Llama-3-8B, #Bit=4.13, Zero-shot=true2025.03 | 67.3 | |
| ClusCompBackbone=Llama-3-8B, #Bit=2.87, Zero-shot=true2025.03 | 64.9 | |
| SliM-LLMBackbone=Llama-3-8B, #Bit=3.13, Zero-shot=true2025.03 | 64.5 | |
| AWQBackbone=Llama-3-8B, #Bit=3.13, Zero-shot=true2025.03 | 64.4 | |
| RTNBackbone=Llama-3-8B, #Bit=4.13, Zero-shot=true2025.03 | 63.9 | |
| QuIPBackbone=Llama-3-8B, #Bit=3.00, Zero-shot=true2025.03 | 63.7 | |
| FP16Zero-shot=true2025.11 | 62.8 | |
| ParoQuantType=linear, Zero-shot=true2025.11 | 61.9 | |
| GPTQBackbone=Llama-3-8B, #Bit=3.13, Zero-shot=true2025.03 | 61.7 | |
| QTIPType=vector, Zero-shot=true2025.11 | 61 | |
| AWQType=linear, Zero-shot=true2025.11 | 59.5 | |
| AWQBackbone=Llama-3-8B, #Bit=3.00, Zero-shot=true2025.03 | 57.8 | |
| ClusCompBackbone=Llama-3-8B, #Bit=2.27, Zero-shot=true2025.03 | 56.4 | |
| E-QATType=linear, Zero-shot=true2025.11 | 55.6 | |
| ClusCompBackbone=Llama-3-8B, #Bit=2.01, Zero-shot=true2025.03 | 53.6 | |
| ClusCompBackbone=Llama-3-8B, #Bit=2.14, Zero-shot=true2025.03 | 51.7 | |
| GPTQBackbone=Llama-3-8B, #Bit=3.00, Zero-shot=true2025.03 | 44.9 | |
| SliM-LLMBackbone=Llama-3-8B, #Bit=2.13, Zero-shot=true2025.03 | 40.8 | |
| RTNBackbone=Llama-3-8B, #Bit=3.13, Zero-shot=true2025.03 | 40.2 | |
| PB-LLMBackbone=Llama-3-8B, #Bit=2.13, Zero-shot=true2025.03 | 38.8 | |
| QuIPBackbone=Llama-3-8B, #Bit=2.00, Zero-shot=true2025.03 | 36.8 | |
| GPTQBackbone=Llama-3-8B, #Bit=2.13, Zero-shot=true2025.03 | 36.2 | |
| RTNBackbone=Llama-3-8B, #Bit=2.13, Zero-shot=true2025.03 | 36 | |
| RTNBackbone=Llama-3-8B, #Bit=3.00, Zero-shot=true2025.03 | 35.6 | |
| AWQBackbone=Llama-3-8B, #Bit=2.00, Zero-shot=true2025.03 | 35.5 | |
| RTNBackbone=Llama-3-8B, #Bit=2.00, Zero-shot=true2025.03 | 35.3 | |
| AWQBackbone=Llama-3-8B, #Bit=2.13, Zero-shot=true2025.03 | 34.9 | |
| GPTQBackbone=Llama-3-8B, #Bit=2.00, Zero-shot=true2025.03 | 34.9 |