Code Generation on HumanEval subset of AceCoder-87K
59.1AccuracyLLaDOU
Evaluation results
| Method | Links | |
|---|---|---|
| LLaDOUSeq Len=2562026.01 | 59.1 | |
| LLaDA-1.5Seq Len=5122026.01 | 51.9 | |
| ESPOSeq Len=5122026.01 | 50 | |
| JustGRPOSeq Len=2562026.01 | 49.4 | |
| JustGRPOSeq Len=5122026.01 | 48.7 | |
| ESPOSeq Len=2562026.01 | 42.1 | |
| LLaDA-1.5Seq Len=2562026.01 | 39.6 | |
| GDPOSeq Len=2562026.01 | 39.6 | |
| GDPOSeq Len=5122026.01 | 39 | |
| JustGRPOSeq Len=1282026.01 | 37.8 | |
| LLaDA-1.5Seq Len=1282026.01 | 29.3 | |
| ESPOSeq Len=1282026.01 | 28.1 | |
| GDPOSeq Len=1282026.01 | 26.2 |