Zero-shot Reasoning on Reasoning Benchmarks Average
75.33Average AccuracyFP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Backbone=Llama-3-70B, Bits=FP162026.06 | 75.33 | |
| LiftQuantBackbone=Llama-3-70B, Bits=2.012026.06 | 72.6 | |
| FP16Backbone=Llama-2-70B, Bits=FP162026.06 | 72.41 | |
| LiftQuantBackbone=Llama-2-70B, Bits=2.412026.06 | 71.39 | |
| QTIPBackbone=Llama-2-70B, Bits=2.002026.06 | 71.12 | |
| LiftQuantBackbone=Llama-2-70B, Bits=2.012026.06 | 71 | |
| QuIP#Backbone=Llama-2-70B, Bits=2.002026.06 | 70.91 | |
| VPTQBackbone=Llama-3-70B, Bits=2.022026.06 | 70.9 | |
| EQAT-g64Backbone=Llama-2-70B, Bits=2.262026.06 | 69.48 | |
| FP16Backbone=Llama-3-8B, Bits=FP162026.06 | 68.58 | |
| EQAT-g64Backbone=Llama-3-70B, Bits=2.252026.06 | 67.89 | |
| FP16Backbone=Llama-2-13B, Bits=FP162026.06 | 67.81 | |
| LiftQuantBackbone=Llama-2-13B, Bits=2.422026.06 | 65.93 | |
| QTIPBackbone=Llama-2-13B, Bits=2.002026.06 | 65.35 | |
| LiftQuantBackbone=Llama-2-13B, Bits=2.022026.06 | 65 | |
| FP16Backbone=Llama-2-7B, Bits=FP162026.06 | 64.85 | |
| QuIP#Backbone=Llama-2-13B, Bits=2.002026.06 | 64.44 | |
| EQAT-g64Backbone=Llama-2-13B, Bits=2.252026.06 | 63.48 | |
| LiftQuantBackbone=Llama-3-8B, Bits=2.022026.06 | 62.73 | |
| LiftQuantBackbone=Llama-2-7B, Bits=2.422026.06 | 62.42 | |
| QTIPBackbone=Llama-2-7B, Bits=2.002026.06 | 62.06 | |
| LiftQuantBackbone=Llama-2-7B, Bits=2.022026.06 | 61.06 | |
| EQAT-g64Backbone=Llama-3-8B, Bits=2.252026.06 | 60.76 | |
| QuIP#Backbone=Llama-2-7B, Bits=2.002026.06 | 60.61 | |
| VPTQBackbone=Llama-3-8B, Bits=2.072026.06 | 60.22 | |
| EQAT-g64Backbone=Llama-2-7B, Bits=2.252026.06 | 60.14 | |
| SVD-LLM(W) + LoRAPARAM. RATE=80%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 53.5 | |
| AIR + LoRAPARAM. RATE=80%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 53.3 | |
| AIR + LoRAPARAM. RATE=60%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 48 | |
| SVD-LLM(W) + LoRAPARAM. RATE=60%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 47.6 | |
| AIR + LoRAPARAM. RATE=40%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 40.8 | |
| SVD-LLM(W) + LoRAPARAM. RATE=40%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 40.5 | |
| AIR + LoRAPARAM. RATE=20%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 34 | |
| SVD-LLM(W) + LoRAPARAM. RATE=20%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.06 | 32.3 |