Coding on HumanEval (Generic Score)
86.59Coding ScoreQwen3-4B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-4BVariant=Instruct, Parameters=4B2026.03 | 86.59 | |
| Jurema-7BVariant=Instruct, Parameters=7B2026.03 | 75.61 | |
| Qwen2.5-3B-InstructVariant=Instruct, Parameters=3B2026.03 | 70.73 | |
| SmolLM3-3BVariant=Instruct, Parameters=3B2026.03 | 68.29 | |
| Gemma-3-Gaia-PT-BR-4b-itVariant=Instruct, Parameters=4B2026.03 | 64.02 | |
| Qwen3-1.7BVariant=Instruct, Parameters=1.7B2026.03 | 64.02 | |
| Qwen2.5-1.5B-InstructVariant=Instruct, Parameters=1.5B2026.03 | 48.78 | |
| Llama-3.2-3B-InstructVariant=Instruct, Parameters=3B2026.03 | 48.17 | |
| Tucano2-qwen-3.7B-InstructVariant=Instruct, Parameters=3.7B2026.03 | 47.56 | |
| Qwen3-0.6BVariant=Instruct, Parameters=0.6B2026.03 | 39.02 | |
| Llama-3.2-1B-InstructVariant=Instruct, Parameters=1B2026.03 | 29.27 | |
| Tucano2-qwen-1.5B-InstructVariant=Instruct, Parameters=1.5B2026.03 | 26.22 | |
| Qwen2.5-0.5B-InstructVariant=Instruct, Parameters=0.5B2026.03 | 24.39 | |
| Tucano2-qwen-0.5B-InstructVariant=Instruct, Parameters=0.5B2026.03 | 10.37 |