Code Generation on BigCodeBench Full 1.0
Evaluation results
| Method | Links | | | | | | | | | |
|---|
| Qwen-3-32BBackbone=Qwen-3-32B2025.10 | | 459 | 495 | 569 | 534 | 517 | 550 | 541 | 516 | 515 |
|---|
| Qwen-2.5-7b-CoderBackbone=Qwen-2.5-7B-Coder2025.10 | | 358 | 401 | 466 | 476 | 447 | 472 | 473 | 446 | 434 |
|---|
| Deepseek-CoderBackbone=DeepSeek-Coder-v22025.10 | | 285 | 328 | 435 | 427 | 404 | 371 | 448 | 400 | 379 |
|---|