Code Generation on LiveCodeBench v6 (Score, #Token)
42.4ScoreGRPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRPOBackbone=DeepSeek-R1-Distill-7B2026.03 | 42.4 | 10,956 | |
| GR3Backbone=DeepSeek-R1-Distill-7B2026.03 | 41.6 | 7,504 | |
| InitialBackbone=DeepSeek-R1-Distill-7B2026.03 | 37.7 | 11,496 | |
| GR3Backbone=DeepSeek-R1-Distill-1.5B2026.03 | 24.9 | 8,538 | |
| GRPOBackbone=DeepSeek-R1-Distill-1.5B2026.03 | 23.4 | 11,830 | |
| InitialBackbone=DeepSeek-R1-Distill-1.5B2026.03 | 17.7 | 12,665 |