List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench Hard

63.9Pass@1DreamPRM-Code
1.011217.338133.66549.9919Sep 26, 2025Nov 2, 2025Dec 9, 2025Jan 15, 2026Feb 21, 2026Mar 30, 2026May 6, 2026
Updated 5mo ago

Evaluation results

MethodLinks
DreamPRM-CodeEvaluation Protocol=Test-Time Scaling, Base Model=O4-mini-high2025.1263.9
ORMEvaluation Protocol=Test-Time Scaling, Base Model=O4-mini-high2025.1262.3
HEARTModel=Gemini 2.5 Flash2025.0960.76
HEARTModel=Gemini 2.5 Pro2025.0960.22
O3Evaluation Protocol=Leaderboard2025.1257.4
O4-mini-highEvaluation Protocol=Leaderboard2025.1257.4
Self ReflectionModel=Gemini 2.5 Flash2025.0956.96
WaitModel=Gemini 2.5 Flash2025.0956.96
CoTModel=Gemini 2.5 Flash2025.0956.65
CoTModel=Gemini 2.5 Pro2025.0955.06
Self ReflectionModel=Gemini 2.5 Pro2025.0954.54
WaitModel=Gemini 2.5 Pro2025.0954.11
Gemini-2.5Evaluation Protocol=Leaderboard2025.1252.5
DeepSeek-R1Evaluation Protocol=Leaderboard2025.1247.2
VanillaModel=Gemini 2.5 Pro2025.0945.73
VanillaModel=Gemini 2.5 Flash2025.0931
DEPO-iter3Base Model=Qwen2.5-Coder-7B-Instruct, Iteration=32026.059.7
XPO-iter3Base Model=Qwen2.5-Coder-7B-Instruct, Iteration=32026.059.4
POPO-iter3Base Model=Qwen2.5-Coder-7B-Instruct, Iteration=32026.059.2
DPO-iter3Base Model=Qwen2.5-Coder-7B-Instruct, Iteration=32026.058.7
Qwen2.5-Coder-7B-Instruct2026.056.9
VanillaModel=Gemma3-12b-Instruct2025.094.29
Self ReflectionModel=Gemma3-12b-Instruct2025.093.71
WaitModel=Gemma3-12b-Instruct2025.093.71
HEARTModel=Gemma3-12b-Instruct2025.093.71
CoTModel=Gemma3-12b-Instruct2025.093.43