Multimodal Understanding on ShopBench
73.8ShopFront ScoreSeed 1.8*
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Seed 1.8*Architecture=MoE2026.01 | 73.8 | 57.9 | 63.5 | 70.1 | 63.9 | 69 | |
| Ostrakon-VLParam=8B, Architecture=Dense2026.01 | 65 | 49.1 | 59.1 | 49.6 | 53.3 | 60.1 | |
| Gemini3-Pro*Architecture=MoE2026.01 | 64.7 | 70.6 | 53.4 | 65.8 | 62.3 | 63.6 | |
| GLM-4.6VParam=106B, Architecture=MoE2026.01 | 64 | 51.1 | 57.3 | 57 | 54.1 | 60 | |
| InternVL3.5-241BParam=241B, Architecture=MoE2026.01 | 63.5 | 52.7 | 62.9 | 59.7 | 54.2 | 61.1 | |
| Qwen3-VL-235BParam=235B, Architecture=MoE2026.01 | 63.2 | 50.3 | 58.6 | 53.1 | 53.3 | 59.4 | |
| GLM-4.6V-FlashXParam=9B, Architecture=Dense2026.01 | 61.9 | 47.6 | 57 | 56.5 | 47.1 | 57.9 | |
| Ovis2.5-9BParam=9B, Architecture=Dense2026.01 | 61.8 | 47.6 | 56.4 | 57.3 | 49.8 | 57.9 | |
| Qwen2.5-VL-72BParam=72B, Architecture=Dense2026.01 | 60.8 | 49.5 | 57.3 | 49.3 | 50.7 | 57.3 | |
| Qwen3-VL-8BParam=8B, Architecture=Dense2026.01 | 59.3 | 46.9 | 54.1 | 46.2 | 50.7 | 55.3 | |
| InternVL3-78BParam=78B, Architecture=Dense2026.01 | 58.3 | 51 | 54.8 | 49.2 | 49.8 | 55.7 | |
| GPT-5*Architecture=MoE2026.01 | 57.2 | 56.2 | 65.3 | 69 | 48.3 | 58.8 | |
| Qwen3-VL-3BParam=3B, Architecture=Dense2026.01 | 56.9 | 44.6 | 53.8 | 47.9 | 49.8 | 53.6 | |
| Gemini2.5-Pro*Architecture=MoE2026.01 | 52.2 | 56.5 | 65.9 | 61.5 | 56.7 | 55.9 | |
| InternVL3.5-8BParam=8B, Architecture=Dense2026.01 | 52 | 46.3 | 50.1 | 41.3 | 47.5 | 49.9 | |
| InternVL3.5-4BParam=4B, Architecture=Dense2026.01 | 50 | 44.3 | 48.7 | 39.3 | 44.5 | 47.9 | |
| MiniCPM-V-4Param=4B, Architecture=Dense2026.01 | 49.2 | 42.3 | 44 | 36.9 | 43.6 | 46.2 | |
| LLava-OneVisionParam=7B, Architecture=Dense2026.01 | 37.5 | 39.2 | 41.6 | 27.1 | 35.2 | 37.6 |