Code Generation on BigCodeBench Full 1.0
459Pass@1Qwen-3-32B
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen-3-32BBackbone=Qwen-3-32B2025.10 | 459 | 495 | 569 | 534 | 517 | 550 | 541 | 516 | 515 | |
| Qwen-2.5-7b-CoderBackbone=Qwen-2.5-7B-Coder2025.10 | 358 | 401 | 466 | 476 | 447 | 472 | 473 | 446 | 434 | |
| Deepseek-CoderBackbone=DeepSeek-Coder-v22025.10 | 285 | 328 | 435 | 427 | 404 | 371 | 448 | 400 | 379 |