List your company
ResearchFormerly WizWand

Aggregate Evaluation on GSM8K, MBPP, HumanEval, ARC-E, and ARC-C

61.16Average ScoreFull
7.91221.73635.5649.384Jun 3, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FullModel=Qwen1.5MoE-A2.7B, E↓=100%, A↓=100%2026.0661.16
TENPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=61.38%2026.0659.06
ENPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=60%2026.0655.88
FullModel=DeepSeek-V2-Lite, E↓=100%, A↓=100%2026.0652.98
TENPModel=DeepSeek-V2-Lite, E↓=60%, A↓=63.76%2026.0651.98
EASY-EPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0648.02
EASY-EPModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0646.18
ENPModel=DeepSeek-V2-Lite, E↓=60%, A↓=60%2026.0643.8
Gating ScoreModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0643.14
TENPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=34.51%2026.0643
ENPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=30%2026.0641.9
FrequencyModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0641.18
FrequencyModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0639.78
TENPModel=DeepSeek-V2-Lite, E↓=30%, A↓=36.38%2026.0639.72
Gating ScoreModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0639.06
RandomModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0632.62
ENPModel=DeepSeek-V2-Lite, E↓=30%, A↓=30%2026.0624.16
EASY-EPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.0621.14
Gating ScoreModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.0620.68
FrequencyModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.0619.66
EASY-EPModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.0615.26
RandomModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0613.56
Gating ScoreModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.0611.28
RandomModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.0610.64
FrequencyModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.0610.04
RandomModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.069.96