Code Reasoning on CUE-Bench
1.2VT ScoreQwen2.5-0.5B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen2.5-0.5BParameter count=0.5B2026.06 | 1.2 | 16 | 10.5 | 15.6 | 8.1 | 9.4 | 10.1 | |
| Qwen2.5-Coder-0.5BParameter count=0.5B2026.06 | 0.9 | 16.3 | 10.4 | 16.2 | 7.7 | 9 | 10.1 | |
| Qwen3-0.6BParameter count=0.6B2026.06 | 0.7 | 12.7 | 6.5 | 13.3 | 4.2 | 5.4 | 7.2 | |
| Qwen2.5-1.5BParameter count=1.5B2026.06 | 0.7 | 11.2 | 6.3 | 12.1 | 5.3 | 5.3 | 6.8 | |
| Qwen2.5-Coder-1.5BParameter count=1.5B2026.06 | 0.5 | 7 | 5.1 | 11.2 | 4.4 | 4.2 | 5.4 | |
| Qwen3-1.7BParameter count=1.7B2026.06 | 0.5 | 8.1 | 4 | 9.8 | 3.3 | 3.7 | 4.9 | |
| Qwen2.5-3BParameter count=3B2026.06 | 0.5 | 8.3 | 4 | 10.7 | 3.5 | 5.2 | 5.3 | |
| Qwen2.5-Coder-3BParameter count=3B2026.06 | 0.5 | 5.7 | 2.6 | 8.3 | 3.1 | 3.5 | 3.9 | |
| CodeLlama-7BParameter count=7B2026.06 | 0.4 | 8.5 | 4.1 | 7.9 | 3.6 | 3.5 | 4.7 | |
| Qwen2.5-Coder-14BParameter count=14B2026.06 | 0.4 | 2.2 | 1.9 | 3.3 | 0.4 | 0.4 | 1.4 | |
| Llama-2-7BParameter count=7B2026.06 | 0.2 | 9.8 | 7.2 | 11.6 | 4.1 | 3.7 | 6.1 | |
| Qwen3-4BParameter count=4B2026.06 | 0.1 | 4.2 | 2.3 | 5.2 | 1.9 | 1.4 | 2.5 | |
| DeepSeek-Coder-6.7BParameter count=6.7B2026.06 | 0.1 | 5.4 | 2.3 | 7 | 2.2 | 1.9 | 3.2 | |
| Qwen2.5-Coder-7BParameter count=7B2026.06 | 0.1 | 4.3 | 2.5 | 5.9 | 1.6 | 1.6 | 2.7 | |
| Qwen2.5-7BParameter count=7B2026.06 | 0 | 5.7 | 2.3 | 8.6 | 2.8 | 3.2 | 3.8 | |
| Qwen3-8BParameter count=8B2026.06 | 0 | 4.6 | 0 | 0 | 0 | 1.9 | 1.1 |