Code Generation on LiveCodeBench (LCB) v5 & v6 (Pass@1 Average)
35.85Pass@1 (LCB-v5)ADR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ADRBase Model=Qwen3-8B, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 35.85 | 31.43 | 33.64 | |
| TACOBase Model=Qwen3-8B, Training Data Source=Real, Data Source Type=Real2026.05 | 34.81 | 27.43 | 31.12 | |
| KodCodeBase Model=Qwen3-8B, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 26.27 | 24.57 | 25.42 | |
| ADRBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 25.37 | 26.14 | 25.76 | |
| Educational InstructBase Model=Qwen3-8B, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 25.15 | 23.5 | 24.32 | |
| KodCodeBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 22.75 | 23.57 | 23.16 | |
| TACOBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Real, Data Source Type=Real2026.05 | 22.6 | 23.86 | 23.23 | |
| Qwen3-8BBase Model=Qwen3-8B, Training Data Source=Original2026.05 | 22.53 | 21.21 | 21.87 | |
| Educational InstructBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 19.61 | 21.71 | 20.66 | |
| ADRBase Model=Llama-3.1-8B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 16.84 | 23 | 19.92 | |
| Qwen2.5-Coder-7B-InstructBase Model=Qwen2.5-Coder-7B-Instruct, Training Data Source=Original2026.05 | 16.17 | 20.21 | 18.19 | |
| KodCodeBase Model=Llama-3.1-8B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 12.2 | 17.93 | 15.06 | |
| TACOBase Model=Llama-3.1-8B-Instruct, Training Data Source=Real, Data Source Type=Real2026.05 | 10.25 | 14.21 | 12.23 | |
| Llama-3.1-8B-InstructBase Model=Llama-3.1-8B-Instruct, Training Data Source=Original2026.05 | 9.36 | 15.71 | 12.54 | |
| Educational InstructBase Model=Llama-3.1-8B-Instruct, Training Data Source=Synthetic, Data Source Type=Synthetic2026.05 | 8.01 | 14.71 | 11.36 |