List your company
ResearchFormerly WizWand

Code Generation on HumanEval (HumanEval Metric)

34.2HumanEvalFull
-1.3687.86617.126.334Jun 3, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FullModel=Qwen1.5MoE-A2.7B, E↓=100%, A↓=100%2026.0634.2
TENPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=61.38%2026.0631.1
TENPModel=DeepSeek-V2-Lite, E↓=60%, A↓=63.76%2026.0629.9
ENPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=60%2026.0628
FullModel=DeepSeek-V2-Lite, E↓=100%, A↓=100%2026.0626.2
EASY-EPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0619.5
ENPModel=DeepSeek-V2-Lite, E↓=60%, A↓=60%2026.0619.5
TENPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=34.51%2026.0618.9
ENPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=30%2026.0617.1
EASY-EPModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0614.6
TENPModel=DeepSeek-V2-Lite, E↓=30%, A↓=36.38%2026.0614
FrequencyModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0611.6
Gating ScoreModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0611.6
Gating ScoreModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.068.5
FrequencyModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.066.7
EASY-EPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.061.8
Gating ScoreModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.061.2
EASY-EPModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.061.2
RandomModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.060
FrequencyModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.060
RandomModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.060
RandomModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.060
FrequencyModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.060
Gating ScoreModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.060
ENPModel=DeepSeek-V2-Lite, E↓=30%, A↓=30%2026.060
RandomModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.060