List your company
ResearchFormerly WizWand

Commonsense Reasoning on HellaSwag (HS)

85.87AccuracyQwen3-235B-A22B
45.67456.109566.54576.9805Jun 25, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Qwen3-235B-A22B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=MoE2026.0685.87
Llama2-70B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0683.86
Qwen3-32B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0682.66
RF2-100B-A6.1B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=MoE2026.0679.27
Qwen3-14B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0678.83
Qwen3-30B-A3B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=MoE2026.0677.66
Llama2-7B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0675.9
Qwen3-8B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0674.92
CAT-QBase Model=Llama2-70B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0674.56
CAT-QBase Model=Qwen3-32B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0674.33
CAT-QBase Model=Qwen3-235B-A22B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=MoE2026.0674.02
Qwen3-4B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0668.41
CAT-QBase Model=RF2-100B-A6.1B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=MoE2026.0667.46
CAT-QBase Model=Qwen3-14B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0667.19
CAT-QBase Model=Qwen3-30B-A3B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=MoE2026.0663.22
CAT-QBase Model=Llama2-7B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0660.95
Qwen3-1.7B#Bits=W16A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0660.36
CAT-QBase Model=Qwen3-8B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0659.57
CAT-QBase Model=Qwen3-8B, #Bits=W1.58A8, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0658.64
CAT-QBase Model=Qwen3-4B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0653.24
CAT-QBase Model=Qwen3-4B, #Bits=W1.58A8, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0651.48
CAT-QBase Model=Qwen3-1.7B, #Bits=W1.58A16, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0647.77
CAT-QBase Model=Qwen3-1.7B, #Bits=W1.58A8, Regime=PTQ, Zero-shot=true, Architecture=Dense2026.0647.22