List your company
ResearchFormerly WizWand

Code Generation on Live Code Generation

24.75Pass@1DOMINO
7.288411.821716.35520.8883May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DOMINOBackbone=QWEN2.5-CODER-14B-Instruct2026.0524.7530.4533.24
QWEN2.5-CODER-14B-InstructBackbone=QWEN2.5-CODER-14B-Instruct2026.0523.3530.1331.73
DOMINO-Direct DomainBackbone=QWEN2.5-CODER-14B-Instruct2026.0521.6228.9731.73
MAGPIE-HumanBackbone=QWEN2.5-CODER-14B-Instruct2026.0520.7827.1728.74
MAGPIE-Few ShotBackbone=QWEN2.5-CODER-14B-Instruct2026.0520.1225.2727.45
Reference SFTBackbone=QWEN2.5-CODER-14B-Instruct2026.0519.6424.8626.33
QWEN2.5-CODER-14B-BaseBackbone=QWEN2.5-CODER-14B-Instruct2026.0519.4626.4227.4
DOMINOBackbone=QWEN2.5-CODER-7B-Instruct2026.0517.3126.8129.94
QWEN2.5-CODER-7B-InstructBackbone=QWEN2.5-CODER-7B-Instruct2026.0516.8821.7323.35
DOMINO-Direct DomainBackbone=QWEN2.5-CODER-7B-Instruct2026.0515.7424.6628.14
MAGPIE-Few ShotBackbone=QWEN2.5-CODER-7B-Instruct2026.0514.3620.9824.23
Reference SFTBackbone=QWEN2.5-CODER-7B-Instruct2026.0513.4721.5923.95
DOMINOBackbone=OPENCODER-8B-Instruct2026.0512.6316.8120.44
MAGPIE-HumanBackbone=QWEN2.5-CODER-7B-Instruct2026.0512.4520.8522.72
DOMINO-Direct DomainBackbone=OPENCODER-8B-Instruct2026.0510.1516.2419.39
OPENCODER-8B-InstructBackbone=OPENCODER-8B-Instruct2026.051017.2319.76
MAGPIE-Few ShotBackbone=OPENCODER-8B-Instruct2026.059.8115.3217.49
Reference SFTBackbone=OPENCODER-8B-Instruct2026.059.3414.1316.88
QWEN2.5-CODER-7B-BaseBackbone=QWEN2.5-CODER-7B-Instruct2026.059.0415.3517.96
MAGPIE-HumanBackbone=OPENCODER-8B-Instruct2026.058.7713.8315.88
OPENCODER-8B-BaseBackbone=OPENCODER-8B-Instruct2026.057.9614.5617.36