List your company
ResearchFormerly WizWand

Zero-shot reasoning on ZeroShot 7

71.57AccuracyFP
34.535644.150353.76563.3797Feb 3, 2026Feb 20, 2026Mar 10, 2026Mar 28, 2026Apr 15, 2026May 3, 2026May 21, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FP#Bits=16.0, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0571.57
FP#Bits=16.0, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0570.97
FPModel=LLaMA3.1-70B, Compression Ratio=1.02026.0267
SAES-SVDModel=LLaMA3.1-70B, Compression Ratio=0.22026.0266
GEMQ#Bits=2.5, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0565.69
Uniform#Bits=2.5, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0565.58
Uniform#Bits=2.5, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0565.49
GEMQ#Bits=2.5, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0565.13
FPModel=Qwen2.5-32B, Compression Ratio=1.02026.0265
PMQ#Bits=2.5, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0564.34
FP#Bits=16.0, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0564.24
SAES-SVDModel=Qwen2.5-32B, Compression Ratio=0.22026.0264
SVD-LLMModel=LLaMA3.1-70B, Compression Ratio=0.22026.0263
FP#Bits=16.0, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0562.32
PMQ#Bits=2.5, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0561.96
Uniform#Bits=2.0, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0561.28
FPModel=LLaMA3.1-8B, Compression Ratio=1.02026.0261
SVD-LLMModel=Qwen2.5-32B, Compression Ratio=0.22026.0261
GEMQ#Bits=2.5, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0560.73
GEMQ#Bits=2.0, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0560.53
PMQ#Bits=2.0, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0560.38
FPModel=Qwen2.5-7B, Compression Ratio=1.02026.0260
GEMQ#Bits=2.0, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0559.98
Uniform#Bits=2.5, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0559.81
PMQ#Bits=2.5, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0559.6
SAES-SVDModel=LLaMA3.1-8B, Compression Ratio=0.22026.0259
GEMQ#Bits=2.5, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0558.38
SAES-SVDModel=Qwen2.5-7B, Compression Ratio=0.22026.0258
SVD-LLMModel=LLaMA3.1-8B, Compression Ratio=0.22026.0257
SVD-LLMModel=Qwen2.5-7B, Compression Ratio=0.22026.0256
Uniform#Bits=2.0, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0555.72
GEMQ#Bits=2.0, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0554.87
PMQ#Bits=2.5, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0554.57
ASVDModel=LLaMA3.1-70B, Compression Ratio=0.22026.0254
GEMQ#Bits=2.0, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0553.8
PMQ#Bits=2.0, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0552.52
GEMQ#Bits=1.5, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0552.45
PMQ#Bits=2.0, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0552.41
ASVDModel=Qwen2.5-32B, Compression Ratio=0.22026.0252
GEMQ#Bits=1.5, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0552
PMQ#Bits=1.5, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0551.78
PMQ#Bits=2.0, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0551.39
GEMQ#Bits=1.5, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0550.55
Uniform#Bits=2.0, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0550.06
ASVDModel=Qwen2.5-7B, Compression Ratio=0.22026.0250
Uniform#Bits=1.5, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0549.42
ASVDModel=LLaMA3.1-8B, Compression Ratio=0.22026.0249
PMQ#Bits=1.5, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0547.58
Uniform#Bits=1.5, Model=Mixtral-8×7B, Evaluation protocol=0-shot2026.0547.45
GEMQ#Bits=1.5, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0547.27
PMQ#Bits=1.5, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0546.91
Uniform#Bits=1.5, Model=DeepSeekV2-Lite, Evaluation protocol=0-shot2026.0545.07
Uniform#Bits=2.5, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0544.12
PMQ#Bits=1.5, Model=Qwen3-30B-A3B, Evaluation protocol=0-shot2026.0542.08
Uniform#Bits=2.0, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0541.06
Uniform#Bits=1.5, Model=Qwen1.5-MoE-A2.7B, Evaluation protocol=0-shot2026.0535.96