Text-to-Code on M3²Bench
91.4Execution Rate (%)Gemini-3-Flash
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-Flashtype=Closed-Source2026.04 | 91.4 | 72.4 | 87.7 | |
| OmniDia-3Bmode=RL, parameters=3B2026.04 | 90.3 | 70.8 | 85 | |
| OmniDia-7Bmode=RL, parameters=7B2026.04 | 89.2 | 71.8 | 84.2 | |
| OmniDia-7Bmode=SFT, parameters=7B2026.04 | 88.7 | 70.6 | 83.5 | |
| GPT-5-minitype=Closed-Source2026.04 | 87.3 | 65.1 | 81.6 | |
| OmniDia-3Bmode=SFT, parameters=3B2026.04 | 86.5 | 64 | 81 | |
| Qwen2.5-VL-72Bbackbone=Qwen2.5-VL, parameters=72B2026.04 | 68.7 | 46.9 | 61.1 | |
| Qwen3-VL-32Bbackbone=Qwen3-VL, parameters=32B2026.04 | 68.5 | 49.1 | 64.5 | |
| InternVL3.5-38Bbackbone=InternVL3.5, parameters=38B2026.04 | 46.6 | 29 | 40.2 | |
| Qwen2.5-VL-7Bbackbone=Qwen2.5-VL, parameters=7B2026.04 | 46.1 | 28.1 | 35.1 | |
| InternVL3.5-14Bbackbone=InternVL3.5, parameters=14B2026.04 | 44.2 | 25.6 | 36.8 | |
| InternVL3.5-8Bbackbone=InternVL3.5, parameters=8B2026.04 | 43.4 | 27.4 | 37.2 | |
| InternVL3-8Bbackbone=InternVL3, parameters=8B2026.04 | 42.6 | 24.4 | 34.8 | |
| Qwen2.5-VL-3Bbackbone=Qwen2.5-VL, parameters=3B2026.04 | 32.6 | 17.9 | 22.8 |