Code Generation on LCB v5 (pass@1, pass@20)
19.93Pass@1GASP + Real-data RL
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GASP + Real-data RLReal-data Training=✓, Real-data Guidance=✓2026.03 | 19.93 | 34.46 | |
| Real-data RLReal-data Training=✓, Real-data Guidance=✗2026.03 | 18.91 | 33.1 | |
| GASPReal-data Training=✗, Real-data Guidance=✓2026.03 | 18.26 | 33.69 | |
| AZRReal-data Training=✗, Real-data Guidance=✗2026.03 | 17.49 | 31.15 | |
| Qwen2.5-Coder-7BReal-data Training=—, Real-data Guidance=—2026.03 | 13.55 | 29.68 |