List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench (solve rate)

48Solve RateDecompRL
4.3215.662738.34Jul 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
DecompRLToken budget=500,000 tokens, Backbone=Qwen 2.5 7B2026.0748
lme16Token budget=500,000 tokens, Backbone=Qwen 2.5 7B2026.0746
pass@8Token budget=500,000 tokens, Backbone=Qwen 2.5 7B2026.0746
DecompRLToken budget=100,000 tokens, Backbone=Qwen 2.5 7B2026.0744
GRPOToken budget=500,000 tokens, Backbone=Qwen 2.5 7B2026.0744
lme48Token budget=500,000 tokens, Backbone=Qwen 2.5 7B2026.0744
pass@8Token budget=100,000 tokens, Backbone=Qwen 2.5 7B2026.0741
DecompRLToken budget=50,000 tokens, Backbone=Qwen 2.5 7B2026.0740
GRPOToken budget=100,000 tokens, Backbone=Qwen 2.5 7B2026.0740
lme16Token budget=100,000 tokens, Backbone=Qwen 2.5 7B2026.0740
pass@8Token budget=50,000 tokens, Backbone=Qwen 2.5 7B2026.0739
lme48Token budget=100,000 tokens, Backbone=Qwen 2.5 7B2026.0739
instructToken budget=500,000 tokens, Backbone=Qwen 2.5 7B2026.0739
GRPOToken budget=50,000 tokens, Backbone=Qwen 2.5 7B2026.0738
lme16Token budget=50,000 tokens, Backbone=Qwen 2.5 7B2026.0738
lme48Token budget=50,000 tokens, Backbone=Qwen 2.5 7B2026.0736
instructToken budget=100,000 tokens, Backbone=Qwen 2.5 7B2026.0733
GRPOToken budget=10,000 tokens, Backbone=Qwen 2.5 7B2026.0732
lme16Token budget=10,000 tokens, Backbone=Qwen 2.5 7B2026.0731
pass@8Token budget=10,000 tokens, Backbone=Qwen 2.5 7B2026.0731
lme48Token budget=10,000 tokens, Backbone=Qwen 2.5 7B2026.0730
instructToken budget=50,000 tokens, Backbone=Qwen 2.5 7B2026.0730
GRPOToken budget=5,000 tokens, Backbone=Qwen 2.5 7B2026.0729
lme16Token budget=5,000 tokens, Backbone=Qwen 2.5 7B2026.0728
pass@8Token budget=5,000 tokens, Backbone=Qwen 2.5 7B2026.0727
lme48Token budget=5,000 tokens, Backbone=Qwen 2.5 7B2026.0726
DecompRLToken budget=10,000 tokens, Backbone=Qwen 2.5 7B2026.0725
instructToken budget=10,000 tokens, Backbone=Qwen 2.5 7B2026.0721
lme16Token budget=1,000 tokens, Backbone=Qwen 2.5 7B2026.0719
GRPOToken budget=1,000 tokens, Backbone=Qwen 2.5 7B2026.0718
DecompRLToken budget=1,000 tokens, Backbone=Qwen 2.5 7B2026.0718
DecompRLToken budget=5,000 tokens, Backbone=Qwen 2.5 7B2026.0718
instructToken budget=5,000 tokens, Backbone=Qwen 2.5 7B2026.0716
pass@8Token budget=1,000 tokens, Backbone=Qwen 2.5 7B2026.0715
lme48Token budget=1,000 tokens, Backbone=Qwen 2.5 7B2026.0712
instructToken budget=1,000 tokens, Backbone=Qwen 2.5 7B2026.076