Code Generation on MBPP+ (Score %)
64.5Score (%)Qwen3-4B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-4BParameters=4B2026.05 | 64.5 | |
| Qwen2.5-7BParameters=7B2026.05 | 64 | |
| Mellum 2Parameters=2.5B/12B2026.05 | 61.4 | |
| Qwen3.5-4BParameters=4B2026.05 | 55 | |
| OLMo-3-7BParameters=7B2026.05 | 52.9 |