Program Synthesis on CodeContests (test)
0.2045Pass@1GRPO-RLVR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRPO-RLVRBackbone=QWEN2.5-72B2026.03 | 0.2045 | 0.3697 | |
| LEAFEBackbone=QWEN2.5-72B2026.03 | 0.1712 | 0.4788 | |
| LEAFEBackbone=LLAMA3-70B2026.03 | 0.1409 | 0.3394 | |
| GRPO-RLVRBackbone=LLAMA3-70B2026.03 | 0.1364 | 0.2788 | |
| BASE (NO FT)Backbone=QWEN2.5-72B2026.03 | 0.1 | 0.3394 | |
| BASE (NO FT)Backbone=LLAMA3-70B2026.03 | 0.0735 | 0.2485 |