Code Generation on LiveCodeBench Hard 2025-02-01 – present
63.9Pass@1FunPRM
Evaluation results
| Method | Links | |
|---|---|---|
| FunPRMBase Model=O4-mini (High), Test-time Scaling Strategy=FunPRM2026.01 | 63.9 | |
| ORMBase Model=O4-mini (High), Test-time Scaling Strategy=Outcome Reward Models2026.01 | 62.3 | |
| Self-CertaintyBase Model=O4-mini (High), Test-time Scaling Strategy=Self-Certainty2026.01 | 59.8 | |
| Skywork-PRMBase Model=O4-mini (High), Test-time Scaling Strategy=Skywork-PRM2026.01 | 59.8 | |
| O3Reasoning Effort=High2026.01 | 57.4 | |
| O4-miniReasoning Effort=High2026.01 | 57.4 | |
| Gemini-2.52026.01 | 52.5 | |
| DeepSeek-R12026.01 | 47.2 |