Code Generation on MBPP AceCoder-87K
52.4AccuracyJustGRPO
Evaluation Results
| Method | Links | |
|---|---|---|
| JustGRPOSeq Len=2562026.01 | 52.4 | |
| LLaDOUSeq Len=2562026.01 | 51.6 | |
| GDPOSeq Len=2562026.01 | 50.6 | |
| JustGRPOSeq Len=1282026.01 | 50.6 | |
| JustGRPOSeq Len=5122026.01 | 49 | |
| ESPOSeq Len=1282026.01 | 47.4 | |
| GDPOSeq Len=5122026.01 | 47.1 | |
| ESPOSeq Len=2562026.01 | 44.6 | |
| ESPOSeq Len=5122026.01 | 44.2 | |
| GDPOSeq Len=1282026.01 | 43.6 | |
| LLaDA-1.5Seq Len=2562026.01 | 39.9 | |
| LLaDA-1.5Seq Len=1282026.01 | 39.6 | |
| LLaDA-1.5Seq Len=5122026.01 | 38.8 |