Coding Proficiency on MBPP (Accuracy, Avg. Time)
66.28AccuracyAtteNT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AtteNTModel=Gemma-7B2026.02 | 66.28 | 2,012 | |
| Standard Fine-tuningModel=Gemma-7B2026.02 | 65.69 | 2,282 | |
| AtteNTModel=Mistral-7B2026.02 | 61.74 | 1,802 | |
| Standard Fine-tuningModel=Mistral-7B2026.02 | 58.52 | 2,042 | |
| AtteNTModel=LLaMA 2-7B2026.02 | 37.61 | 2,132 | |
| Standard Fine-tuningModel=LLaMA 2-7B2026.02 | 35.65 | 2,461 |