List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on Arc-Easy v1 (test)

83.21AccuracyFP16
24.117239.458654.870.1414Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FP16Backbone=Qwen3-32B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0683.21
FP16Backbone=Qwen3-14B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0683.08
FP16Backbone=LLaMA2-70B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0681.02
FP16Backbone=Qwen3-8B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0680.93
TWLABackbone=LLaMA2-70B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0680.73
TWLABackbone=Qwen3-32B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0679.53
FP16Backbone=LLaMA3-8B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0677.9
FP16Backbone=LLaMA2-13B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0677.57
TWLABackbone=Qwen3-14B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0676.26
QuaRotBackbone=LLaMA2-70B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0675.5
FP16Backbone=LLaMA2-7B, Weight bits=16, Activation bits=16, Setting=Zero-shot2026.0674.66
SliM-LLMBackbone=Qwen3-32B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.0674.03
TWLABackbone=Qwen3-8B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0671.38
PB-LLMBackbone=Qwen3-32B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0671.04
PT2-LLMBackbone=LLaMA2-70B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0671
TWLABackbone=LLaMA2-13B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0670.24
TWLABackbone=LLaMA3-8B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0667.3
TWLABackbone=LLaMA2-7B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0665.87
PT2-LLMBackbone=LLaMA2-13B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0662.85
SliM-LLMBackbone=LLaMA2-13B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.0656.71
PT2-LLMBackbone=Qwen3-14B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0653.03
SliM-LLMBackbone=Qwen3-14B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.0652.7
QuaRotBackbone=LLaMA2-13B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0651.98
SliM-LLMBackbone=LLaMA2-7B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.0650.44
PB-LLMBackbone=LLaMA2-70B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0650.05
GPTQBackbone=LLaMA2-70B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0649.83
PT2-LLMBackbone=LLaMA2-7B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0647.01
PB-LLMBackbone=Qwen3-14B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0646.21
SliM-LLMBackbone=Qwen3-8B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.0642.45
PB-LLMBackbone=Qwen3-8B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0641.08
QuaRotBackbone=LLaMA2-7B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0640.95
QuaRotBackbone=LLaMA3-8B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0640.87
GPTQBackbone=Qwen3-32B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0638.72
PT2-LLMBackbone=LLaMA3-8B, Weight bits=1.58, Activation bits=16, Setting=Zero-shot2026.0634.22
GPTQBackbone=Qwen3-14B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0632.49
GPTQBackbone=LLaMA2-7B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0632.45
SliM-LLMBackbone=LLaMA3-8B, Weight bits=2MP, Activation bits=16, Setting=Zero-shot2026.0631.82
PB-LLMBackbone=LLaMA3-8B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0631.52
GPTQBackbone=Qwen3-8B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0630.35
PB-LLMBackbone=LLaMA2-7B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0629.29
GPTQBackbone=LLaMA3-8B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0628.28
PB-LLMBackbone=LLaMA2-13B, Weight bits=1.7, Activation bits=16, Setting=Zero-shot2026.0627.82
GPTQBackbone=LLaMA2-13B, Weight bits=2, Activation bits=16, Setting=Zero-shot2026.0626.39