List your company
ResearchFormerly WizWand

Zero-shot Question Answering on AveQA

57.7AccuracyAMP
35.0840.952546.82552.6975Dec 25, 2025
Updated 8mo ago

Evaluation results

MethodLinks
AMPModel Scale=OPT-30B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1257.7
ARB-RCModel Scale=OPT-30B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1257.11
AMPModel Scale=OPT-13B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1255.06
ARB-RCModel Scale=OPT-13B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1255.01
AMPModel Scale=OPT-6.7B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1253.33
ARB-RCModel Scale=OPT-6.7B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1252.58
ARB-XModel Scale=OPT-30B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1251.77
BiLLMModel Scale=OPT-30B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1249.61
ARB-XModel Scale=OPT-13B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1249.19
AMPModel Scale=OPT-2.7B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1249.03
ARB-RCModel Scale=OPT-2.7B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1248.25
BiLLMModel Scale=OPT-13B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1247
ARB-XModel Scale=OPT-6.7B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1246.57
AMPModel Scale=OPT-1.3B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1245.76
ARB-RCModel Scale=OPT-1.3B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1245.22
PB-LLMModel Scale=OPT-30B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.72025.1243.7
ARB-XModel Scale=OPT-2.7B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1242.21
ARB-XModel Scale=OPT-1.3B, Output Alignment (OA)=true, Block Size=128, Weight Bits=1.112025.1240.52
BiLLMModel Scale=OPT-2.7B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1240.44
BiLLMModel Scale=OPT-1.3B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1238.89
BiLLMModel Scale=OPT-6.7B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.112025.1238.27
PB-LLMModel Scale=OPT-13B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.72025.1237.4
PB-LLMModel Scale=OPT-2.7B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.72025.1237.06
PB-LLMModel Scale=OPT-1.3B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.72025.1236.6
PB-LLMModel Scale=OPT-6.7B, Weight Alignment (WA)=true, Block Size=128, Weight Bits=1.72025.1235.95