List your company
ResearchFormerly WizWand

Code Generation on MBPP+ (Accuracy, Token Usage, Speed)

0.738AccuracyLatentMAS
0.630880.658690.68650.71431Nov 25, 2025
Updated 5mo ago

Evaluation results

MethodLinks
LatentMASBackbone=Qwen3-14B, MAS Setting=Hierarchical2025.110.7381,1872,507
TextMASBackbone=Qwen3-14B, MAS Setting=Hierarchical2025.110.737,4589,162
LatentMASBackbone=Qwen3-8B, MAS Setting=Hierarchical2025.110.7221,2641,387
TextMASBackbone=Qwen3-8B, MAS Setting=Hierarchical2025.110.7197,7033,898
LatentMASBackbone=Qwen3-4B, MAS Setting=Hierarchical2025.110.7061,339489
TextMASBackbone=Qwen3-4B, MAS Setting=Hierarchical2025.110.6936,7821,766
SingleBackbone=Qwen3-14B, MAS Setting=Hierarchical2025.110.6851,8582,410
SingleBackbone=Qwen3-8B, MAS Setting=Hierarchical2025.110.6482,0531,064
SingleBackbone=Qwen3-4B, MAS Setting=Hierarchical2025.110.6351,634523