List your company
ResearchFormerly WizWand

Code Generation on MBPP (MBPP)

47.6MBPP AccuracyFull
-1.90410.94823.836.652Jun 3, 2026
Updated 4mo ago

Evaluation results

MethodLinks
FullModel=Qwen1.5MoE-A2.7B, E↓=100%, A↓=100%2026.0647.6
TENPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=61.38%2026.0645.7
TENPModel=DeepSeek-V2-Lite, E↓=60%, A↓=63.76%2026.0645.7
FullModel=DeepSeek-V2-Lite, E↓=100%, A↓=100%2026.0643.2
EASY-EPModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0642.1
ENPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=60%2026.0640.6
EASY-EPModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0635.4
ENPModel=DeepSeek-V2-Lite, E↓=60%, A↓=60%2026.0633.9
TENPModel=DeepSeek-V2-Lite, E↓=30%, A↓=36.38%2026.0633.1
Gating ScoreModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0630.7
TENPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=34.51%2026.0625.3
ENPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=30%2026.0625.1
FrequencyModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.0624.4
Gating ScoreModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0618.9
FrequencyModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.0614.6
ENPModel=DeepSeek-V2-Lite, E↓=30%, A↓=30%2026.069.1
EASY-EPModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.064.3
RandomModel=Qwen1.5MoE-A2.7B, E↓=60%, A↓=100%2026.061.2
Gating ScoreModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.060.4
EASY-EPModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.060.4
RandomModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.060
FrequencyModel=Qwen1.5MoE-A2.7B, E↓=30%, A↓=100%2026.060
RandomModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.060
FrequencyModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.060
Gating ScoreModel=DeepSeek-V2-Lite, E↓=30%, A↓=100%2026.060
RandomModel=DeepSeek-V2-Lite, E↓=60%, A↓=100%2026.060