List your company
ResearchFormerly WizWand

Code Generation on BigCodeBench (BigCodeBench Metric)

24.2BigCodeBench ScoreTaskFT-SPEED-24+BoS
-0.6496565.80169712.2530518.704403May 7, 2026May 10, 2026May 13, 2026May 16, 2026May 19, 2026May 22, 2026May 26, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TaskFT-SPEED-24+BoSFine-tuning=OpenCodeInstruct, K=24, Visibility Policy=SPEED+BoS2026.0524.2
TaskFT-SPEED-28+BoSFine-tuning=OpenCodeInstruct, K=28, Visibility Policy=SPEED+BoS2026.0523.8
TaskFT-FullFine-tuning=OpenCodeInstruct, Depth=Full2026.0523.7
TaskFT-SPEED-20+BoSFine-tuning=OpenCodeInstruct, K=20, Visibility Policy=SPEED+BoS2026.0520.3
MONA2026.050.3377
AdamW2026.050.3123
Muon2026.050.3061