Visual Question Answering on Colon-Bench Prompted
78.6AccuracyGemini 3 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 3 Pro2026.03 | 78.6 | |
| Gemini 3 ProPrompted=true2026.03 | 78.6 | |
| Gemini 3 Flash2026.03 | 76.6 | |
| Gemini 3 FlashPrompted=true2026.03 | 76.6 | |
| Gemini 3.1 Flash Lite2026.03 | 69.2 | |
| Gemini 3.1 F. Li.Prompted=true2026.03 | 69.2 | |
| Seed 1.62026.03 | 62.9 | |
| Seed 1.6Prompted=true2026.03 | 62.9 | |
| GLM-4.6V2026.03 | 55.7 | |
| GLM-4.6VPrompted=true2026.03 | 55.7 | |
| Qwen3.5 397B2026.03 | 49 | |
| Qwen3.5 397BPrompted=true2026.03 | 49 | |
| Gemini 2.5 Flash Lite2026.03 | 47.8 | |
| Gemini 2.5 F. Li.Prompted=true2026.03 | 47.8 | |
| Qwen3-VL 235B2026.03 | 46.7 | |
| Qwen3-VL 235BPrompted=true2026.03 | 46.7 | |
| Molmo 2-8B2026.03 | 46.1 | |
| Molmo 2-8BPrompted=true2026.03 | 46.1 | |
| Qwen3.5 Plus2026.03 | 44.3 | |
| Qwen3.5 PlusPrompted=true2026.03 | 44.3 | |
| Qwen3-VL Plus2026.03 | 41.2 | |
| Qwen3-VL 32B2026.03 | 39.3 | |
| Qwen3-VL 32BPrompted=true2026.03 | 39.3 | |
| Qwen-VL Max2026.03 | 39.1 | |
| Qwen-VL MaxPrompted=true2026.03 | 39.1 | |
| Seed 1.6 Flash2026.03 | 38.1 | |
| Seed 1.6 FlashPrompted=true2026.03 | 38.1 | |
| Qwen3-VL 8B2026.03 | 32.9 | |
| Qwen3-VL 8BPrompted=true2026.03 | 32.9 |