Code Generation on HumanEval (Average Rank)
1.3Average Rankgpt-oss-20b
Evaluation results
| Method | Links | |
|---|---|---|
| gpt-oss-20bParameters=20B2026.05 | 1.3 | |
| Qwen3-4BParameters=4B2026.05 | 1.8 | |
| GPT-5 nano2026.05 | 3 | |
| Qwen3-8BParameters=8B2026.05 | 4 | |
| gemma-3-12b-itParameters=12B, Instruction Tuned=true2026.05 | 5.5 | |
| EngGPT2-16B-A3BParameters=16B2026.05 | 6.5 | |
| gemma-3-4b-itParameters=4B, Instruction Tuned=true2026.05 | 7 | |
| Moonlight-16B-A3BParameters=16B2026.05 | 7 | |
| Llama-3.2-3BParameters=3B2026.05 | 9.5 | |
| Ministral-3-8BParameters=8B2026.05 | 10.5 | |
| LLaMAntino-3-8BParameters=8B2026.05 | 11 | |
| Llama-3.1-8BParameters=8B2026.05 | 11.8 | |
| FastwebMIIA-7BParameters=7B2026.05 | 12.5 | |
| deepseek-moe-16bParameters=16B2026.05 | 13.8 | |
| Velvet-14BParameters=14B2026.05 | 15 | |
| Minerva-7BParameters=7B2026.05 | 16 |