List your company
ResearchFormerly WizWand

Code Generation on MBPP (Test accuracy %)

42.4Test Accuracy (%)StableDRL
29.9233.1636.439.64May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
StableDRLGeneration Length=5122026.0542.4
wd1Generation Length=5122026.0541.8
GDPOGeneration Length=5122026.0541.6
SPGGeneration Length=5122026.0541.4
SFTGeneration Length=5122026.0541
Diffu-GRPOGeneration Length=5122026.0540.8
d1Generation Length=5122026.0540.8
ESPOGeneration Length=5122026.0540.6
LLaDA-8B-InstructGeneration Length=5122026.0540.4
AdaBlock-dLLMGeneration Length=5122026.0539.6
GDPOGeneration Length=2562026.0535
StableDRLGeneration Length=2562026.0534.8
d1Generation Length=2562026.0534.4
SPGGeneration Length=2562026.0534.2
AdaBlock-dLLMGeneration Length=2562026.0534
Diffu-GRPOGeneration Length=2562026.0534
wd1Generation Length=2562026.0534
ESPOGeneration Length=2562026.0533.8
LLaDA-8B-InstructGeneration Length=2562026.0533.6
SFTGeneration Length=2562026.0530.4