Code Generation on MBPP (Accuracy)
0.726AccuracyGemma 2 27B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma 2 27B2026.02 | 0.726 | |
| Llama 70B2026.02 | 0.704 | |
| Mistral 24B2026.02 | 0.672 | |
| FiMI Instruct2026.02 | 0.652 | |
| NeMo 12B IT2026.02 | 0.572 | |
| Llama 3.1 8B2026.02 | 0.486 | |
| Mistral 7B2026.02 | 0.4 |