Code Generation on MBPP (Test accuracy %)
42.4Test Accuracy (%)StableDRL
Evaluation Results
| Method | Links | |
|---|---|---|
| StableDRLGeneration Length=5122026.05 | 42.4 | |
| wd1Generation Length=5122026.05 | 41.8 | |
| GDPOGeneration Length=5122026.05 | 41.6 | |
| SPGGeneration Length=5122026.05 | 41.4 | |
| SFTGeneration Length=5122026.05 | 41 | |
| Diffu-GRPOGeneration Length=5122026.05 | 40.8 | |
| d1Generation Length=5122026.05 | 40.8 | |
| ESPOGeneration Length=5122026.05 | 40.6 | |
| LLaDA-8B-InstructGeneration Length=5122026.05 | 40.4 | |
| AdaBlock-dLLMGeneration Length=5122026.05 | 39.6 | |
| GDPOGeneration Length=2562026.05 | 35 | |
| StableDRLGeneration Length=2562026.05 | 34.8 | |
| d1Generation Length=2562026.05 | 34.4 | |
| SPGGeneration Length=2562026.05 | 34.2 | |
| AdaBlock-dLLMGeneration Length=2562026.05 | 34 | |
| Diffu-GRPOGeneration Length=2562026.05 | 34 | |
| wd1Generation Length=2562026.05 | 34 | |
| ESPOGeneration Length=2562026.05 | 33.8 | |
| LLaDA-8B-InstructGeneration Length=2562026.05 | 33.6 | |
| SFTGeneration Length=2562026.05 | 30.4 |