List your company
ResearchFormerly WizWand

Code Generation on LCB v5 (Accuracy)

61.5AccuracyQwen3-30B-A3B
22.91632.93342.9552.967Oct 11, 2025Nov 16, 2025Dec 23, 2025Jan 28, 2026Mar 6, 2026Apr 11, 2026May 18, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Qwen3-30B-A3BBase Model=Qwen3-30B-A3B2026.0561.5
ZEDASFTBase Model=Qwen3-30B-A3B2026.0558.2
ZEDABase Model=Qwen3-30B-A3B2026.0558.2
Dynamic SkippingBase Model=Qwen3-30B-A3B2026.0557.3
NETSFT→OPDBase Model=Qwen3-30B-A3B2026.0557
NETSFTBase Model=Qwen3-30B-A3B2026.0556.5
ZEDABase Model=GLM-4.7-Flash2026.0551.6
NETSFTBase Model=GLM-4.7-Flash2026.0550.6
ZEDASFTBase Model=GLM-4.7-Flash2026.0549.9
NETSFT→OPDBase Model=GLM-4.7-Flash2026.0549.5
GLM-4.7-FlashBase Model=GLM-4.7-Flash2026.0548
Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Base+Tool2026.0439.76
ParaManagerOrchestration Strategy=Unified2026.0439.45
ParaManager-SerialOrchestration Strategy=Serial2026.0439.43
Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Self Refine2026.0439.42
Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Majority Vote2026.0439.28
ParaManager-MonoOrchestration Strategy=Mono2026.0439.2
RouterOrchestration Strategy=Static Workflow2026.0439.15
Qwen3-30B A3B-Instruct-2507Orchestration Strategy=Base2026.0439.12
PuppeteerOrchestration Strategy=Serial Orchestration2026.0439.11
Qwen3-4B Instruct-2507Orchestration Strategy=Self Refine2026.0438.36
ToolOrchestraOrchestration Strategy=Serial Orchestration2026.0437.64
Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Self Refine2026.0437.6
GPT-OSS-20BOrchestration Strategy=Self Refine2026.0437.2
Qwen3-4B Instruct-2507Orchestration Strategy=Base+Tool2026.0437.15
Qwen3-4B Instruct-2507Orchestration Strategy=Base2026.0436.6
Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Base+Tool2026.0436.2
AdaMoEBase Model=Qwen3-30B-A3B2026.0536.1
Qwen3-4B Instruct-2507Orchestration Strategy=Majority Vote2026.0435.83
Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Majority Vote2026.0435.2
Qwen3-Coder 30B-A3B-InstructOrchestration Strategy=Base2026.0434.76
GPT-OSS-20BOrchestration Strategy=Base+Tool2026.0434.58
GPT-OSS-20BOrchestration Strategy=Majority Vote2026.0434.5
GPT-OSS-20BOrchestration Strategy=Base2026.0433.53
EvoFlowOrchestration Strategy=Static Workflow2026.0433.06
Dynamic SkippingBase Model=GLM-4.7-Flash2026.0532.3
Meta Agent SearchOrchestration Strategy=Static Workflow2026.0432.08
STEERModel Size=14B2025.1031.8
ParaManager-SFTOrchestration Strategy=SFT2026.0430.8
GRPOModel Size=14B2025.1029.3
STEERModel Size=7B2025.1029.2
GRPOModel Size=7B2025.1028.5
AdaMoEBase Model=GLM-4.7-Flash2026.0526.4
STEERModel Size=3B2025.1024.9
GRPOModel Size=3B2025.1024.4