List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench (LCB) v5 & v6 (Pass@1 Average)

35.85Pass@1 (LCB-v5)ADR
6.896414.413221.9329.4468May 29, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ADRBase Model=Qwen3-8B, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0535.8531.4333.64
TACOBase Model=Qwen3-8B, Training Data Source=Real, Data Source Type=Real2026.0534.8127.4331.12
KodCodeBase Model=Qwen3-8B, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0526.2724.5725.42
ADRBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0525.3726.1425.76
Educational InstructBase Model=Qwen3-8B, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0525.1523.524.32
KodCodeBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0522.7523.5723.16
TACOBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Real, Data Source Type=Real2026.0522.623.8623.23
Qwen3-8BBase Model=Qwen3-8B, Training Data Source=Original2026.0522.5321.2121.87
Educational InstructBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0519.6121.7120.66
ADRBase Model=Llama-3.1-8B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0516.842319.92
Qwen2.5-Coder-7B-InstructBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Original2026.0516.1720.2118.19
KodCodeBase Model=Llama-3.1-8B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.0512.217.9315.06
TACOBase Model=Llama-3.1-8B-Instruct, Training Data Source=Real, Data Source Type=Real2026.0510.2514.2112.23
Llama-3.1-8B-InstructBase Model=Llama-3.1-8B-Instruct, Training Data Source=Original2026.059.3615.7112.54
Educational InstructBase Model=Llama-3.1-8B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.058.0114.7111.36