Code Generation on MBPP+ Beginner persona
94Win-rateGPT-5.1 vs. GPT-4o
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-5.1 vs. GPT-4oPrompt Type=Personalized2026.04 | 94 | 1 | |
| Gemini-3-Pro vs. Gemma-3-4BPrompt Type=Personalized2026.04 | 93 | 1 | |
| GPT-5.1 vs. GPT-OSS-20BPrompt Type=Personalized2026.04 | 77 | 2 | |
| Qwen3-32B vs. Qwen3-14BPrompt Type=Original2026.04 | 54 | 4 | |
| Qwen3-32B vs. Qwen3-14BPrompt Type=Personalized2026.04 | 54 | 2 | |
| Qwen3-32B vs. Qwen3-14BPrompt Type=Control2026.04 | 54 | 5 | |
| Gemini-3-Pro vs. Gemma-3-4BPrompt Type=Original2026.04 | 48 | 2 | |
| Gemini-3-Pro vs. Gemma-3-4BPrompt Type=Control2026.04 | 44 | 2 | |
| GPT-5.1 vs. GPT-4oPrompt Type=Original2026.04 | 9 | 0 | |
| GPT-5.1 vs. GPT-4oPrompt Type=Control2026.04 | 8 | 1 | |
| GPT-5.1 vs. GPT-OSS-20BPrompt Type=Control2026.04 | 6 | 0 | |
| GPT-5.1 vs. GPT-OSS-20BPrompt Type=Original2026.04 | 3 | 0 |