List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench (LCB) (% Avg@4)

32.4% Avg@4RF++ B + RePro
17.42421.31225.229.088Dec 1, 2025
Updated 8mo ago

Evaluation results

MethodLinks
RF++ B + ReProBackbone=Qwen3-1.7B2025.1232.4
GRPO + ReProBackbone=Qwen3-1.7B2025.1232
PPO + ReProBackbone=Qwen3-1.7B2025.1231.5
PPOBackbone=Qwen3-1.7B2025.1231.3
RF++ BBackbone=Qwen3-1.7B2025.1231.1
OriginalBackbone=Qwen3-1.7B2025.1230.6
GRPOBackbone=Qwen3-1.7B2025.1230.2
GRPO + ReProBackbone=Hunyuan-1.8B-Instruct2025.1227.7
GRPOBackbone=Hunyuan-1.8B-Instruct2025.1227.1
RF++ BBackbone=Hunyuan-1.8B-Instruct2025.1226.5
PPO + ReProBackbone=Hunyuan-1.8B-Instruct2025.1226.3
RF++ B + ReProBackbone=Hunyuan-1.8B-Instruct2025.1226.2
PPOBackbone=Hunyuan-1.8B-Instruct2025.1225.9
OriginalBackbone=Hunyuan-1.8B-Instruct2025.1224.5
PPO + ReProBackbone=MobileLLM-R1-950M2025.1221.4
PPOBackbone=MobileLLM-R1-950M2025.1219.8
OriginalBackbone=MobileLLM-R1-950M2025.1218