List your company
ResearchFormerly WizWand

Code Generation on MBPP+ (Acc, TPF)

75.66AccuracySingleBD (Native)
51.178457.534263.8970.2458Jun 28, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SingleBD (Native)Backbone=LLaDA2-Mini, bufsz=2, blksz=322026.0675.663.25
MultiBD (training-free)Backbone=LLaDA2-Mini, bufsz=2, blksz=322026.0672.493.97
MBD-LLaDA2-MiniBackbone=LLaDA2-Mini, bufsz=2, blksz=322026.0672.495.35
SingleBD (Native)Backbone=LLaDA2-Mini-DMax, bufsz=2, blksz=322026.0672.226.14
MultiBD (training-free)Backbone=LLaDA2-Mini-DMax, bufsz=2, blksz=322026.0672.228.44
MBD-LLaDA2-Mini-DMaxBackbone=LLaDA2-Mini-DMax, bufsz=2, blksz=322026.0670.118.34
MultiBD (training-free)Backbone=SDAR-8B-Chat-b4, bufsz=4, blksz=42026.0665.81.55
SingleBD (Native)Backbone=SDAR-8B-Chat-b4, bufsz=4, blksz=42026.0664.81.13
MBD-SDAR-8B-Chat-b4Backbone=SDAR-8B-Chat-b4, bufsz=4, blksz=42026.0664.292.62
MBD-SDAR-8B-Chat-b32Backbone=SDAR-8B-Chat-b32, bufsz=4, blksz=322026.0658.994.87
SingleBD (Native)Backbone=SDAR-8B-Chat-b32, bufsz=4, blksz=322026.0652.651.83
MultiBD (training-free)Backbone=SDAR-8B-Chat-b32, bufsz=4, blksz=322026.0652.121.97