Code Generation on LiveCodeBench Medium 2025-02-01 – present (pass@1)
0.923Pass@1FunPRM
Evaluation results
| Method | Links | |
|---|---|---|
| FunPRMBase Model=O4-mini (High), Test-time Scaling Strategy=FunPRM2026.01 | 0.923 | |
| O4-miniReasoning Effort=High2026.01 | 0.897 | |
| ORMBase Model=O4-mini (High), Test-time Scaling Strategy=Outcome Reward Models2026.01 | 0.897 | |
| Skywork-PRMBase Model=O4-mini (High), Test-time Scaling Strategy=Skywork-PRM2026.01 | 0.872 | |
| Self-CertaintyBase Model=O4-mini (High), Test-time Scaling Strategy=Self-Certainty2026.01 | 0.865 | |
| Gemini-2.52026.01 | 0.821 | |
| DeepSeek-R12026.01 | 0.777 | |
| O3Reasoning Effort=High2026.01 | 0.718 |