List your company
ResearchFormerly WizWand

Code Generation on LCB v5 (pass@1)

49.5pass@1Lightning OPD
11.259221.187131.11541.0429Mar 16, 2026Mar 30, 2026Apr 13, 2026Apr 27, 2026May 11, 2026May 25, 2026Jun 8, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Lightning OPDStudent=Qwen3-8B-Base, Teacher=Qwen3-32B2026.0449.5
OPDStudent=Qwen3-8B-Base, Teacher=Qwen3-32B2026.0447.3
SFTStudent=Qwen3-8B-Base, Teacher=Qwen3-32B2026.0444.7
OPDStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.0444.2
Lightning OPDStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.0442.8
SFTStudent=Qwen3-4B-Base, Teacher=Qwen3-8B2026.0433.8
PriFT-massBackbone=Qwen2.5-Coder-3B2026.0622.27
OriginalBackbone=Qwen2.5-Coder-3B2026.0621.25
ASFTBackbone=Qwen2.5-Coder-3B2026.0620.8
GASP + Real-data RLBase Model=Qwen2.5-Coder-7B, Decoding=Greedy2026.0320.52
GASPBase Model=Qwen2.5-Coder-7B, Decoding=Greedy2026.0319.75
Real-data RLBase Model=Qwen2.5-Coder-7B, Decoding=Greedy2026.0318.21
PriFT-probBackbone=Qwen2.5-Coder-3B2026.0617.73
EAFTBackbone=Qwen2.5-Coder-3B2026.0617.61
AZRBase Model=Qwen2.5-Coder-7B, Decoding=Greedy2026.0317.13
SFTBackbone=Qwen2.5-Coder-3B2026.0617.05
IDFTBackbone=Qwen2.5-Coder-3B2026.0616.36
Qwen2.5-Coder-7BDecoding=Greedy2026.0313.89
TALRBackbone=Qwen2.5-Coder-3B2026.0612.84
DFTBackbone=Qwen2.5-Coder-3B2026.0612.73