List your company
ResearchFormerly WizWand

Zero-shot Reasoning on Reasoning Benchmarks Average

75.33Average AccuracyFP16
30.578842.196953.81565.4331Jun 2, 2026Jun 4, 2026Jun 7, 2026Jun 10, 2026Jun 12, 2026Jun 15, 2026Jun 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FP16Backbone=Llama-3-70B, Bits=FP162026.0675.33
LiftQuantBackbone=Llama-3-70B, Bits=2.012026.0672.6
FP16Backbone=Llama-2-70B, Bits=FP162026.0672.41
LiftQuantBackbone=Llama-2-70B, Bits=2.412026.0671.39
QTIPBackbone=Llama-2-70B, Bits=2.002026.0671.12
LiftQuantBackbone=Llama-2-70B, Bits=2.012026.0671
QuIP#Backbone=Llama-2-70B, Bits=2.002026.0670.91
VPTQBackbone=Llama-3-70B, Bits=2.022026.0670.9
EQAT-g64Backbone=Llama-2-70B, Bits=2.262026.0669.48
FP16Backbone=Llama-3-8B, Bits=FP162026.0668.58
EQAT-g64Backbone=Llama-3-70B, Bits=2.252026.0667.89
FP16Backbone=Llama-2-13B, Bits=FP162026.0667.81
LiftQuantBackbone=Llama-2-13B, Bits=2.422026.0665.93
QTIPBackbone=Llama-2-13B, Bits=2.002026.0665.35
LiftQuantBackbone=Llama-2-13B, Bits=2.022026.0665
FP16Backbone=Llama-2-7B, Bits=FP162026.0664.85
QuIP#Backbone=Llama-2-13B, Bits=2.002026.0664.44
EQAT-g64Backbone=Llama-2-13B, Bits=2.252026.0663.48
LiftQuantBackbone=Llama-3-8B, Bits=2.022026.0662.73
LiftQuantBackbone=Llama-2-7B, Bits=2.422026.0662.42
QTIPBackbone=Llama-2-7B, Bits=2.002026.0662.06
LiftQuantBackbone=Llama-2-7B, Bits=2.022026.0661.06
EQAT-g64Backbone=Llama-3-8B, Bits=2.252026.0660.76
QuIP#Backbone=Llama-2-7B, Bits=2.002026.0660.61
VPTQBackbone=Llama-3-8B, Bits=2.072026.0660.22
EQAT-g64Backbone=Llama-2-7B, Bits=2.252026.0660.14
SVD-LLM(W) + LoRAPARAM. RATE=80%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0653.5
AIR + LoRAPARAM. RATE=80%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0653.3
AIR + LoRAPARAM. RATE=60%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0648
SVD-LLM(W) + LoRAPARAM. RATE=60%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0647.6
AIR + LoRAPARAM. RATE=40%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0640.8
SVD-LLM(W) + LoRAPARAM. RATE=40%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0640.5
AIR + LoRAPARAM. RATE=20%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0634
SVD-LLM(W) + LoRAPARAM. RATE=20%, Backbone=LLaMA 7B, Fine-tuning Protocol=LoRA2026.0632.3