Real-world Multimodal Interaction on RealWorldQA
76.5RealWorldQA ScoreGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oOpen Data=false, Super-Image (SI)=false2025.12 | 76.5 | |
| MAmmoTH-VLLLM Backbone=Qwen2.5-7B, Open Data=true, Super-Image (SI)=true2025.12 | 71.3 | |
| InternVL3LLM Backbone=Qwen2.5-7B, Open Data=false, Super-Image (SI)=false2025.12 | 70.8 | |
| Molmo-8B-DLLM Backbone=Qwen2 7B, Open Data=true, Super-Image (SI)=false2025.12 | 70.7 | |
| Gemini-1.5 ProOpen Data=false, Super-Image (SI)=false2025.12 | 70.4 | |
| MAmmoTH-VLLLM Backbone=Qwen2.5-7B, Open Data=true, Super-Image (SI)=false2025.12 | 69.9 | |
| Qwen2.5-VLLLM Backbone=Qwen2.5-7B, Open Data=false, Super-Image (SI)=false2025.12 | 68.5 | |
| DeepSeek-VL2LLM Backbone=DeepSeek-MoE 27B, Open Data=false, Super-Image (SI)=false2025.12 | 68.4 | |
| Dream-VLLLM Backbone=Dream 7B, Open Data=true, Super-Image (SI)=true2025.12 | 68.4 | |
| LLaVA-OVLLM Backbone=Qwen2-7B, Open Data=true, Super-Image (SI)=false2025.12 | 66.3 | |
| Dream-VLLLM Backbone=Dream 7B, Open Data=true, Super-Image (SI)=false2025.12 | 66.3 | |
| LLaVA-OVLLM Backbone=Qwen2-7B, Open Data=true, Super-Image (SI)=true2025.12 | 65.5 | |
| Cambrian-1LLM Backbone=LLaMA3-8B, Open Data=true, Super-Image (SI)=false2025.12 | 64.2 | |
| LLaDA-VLLM Backbone=LLaDA 8B, Open Data=true, Super-Image (SI)=false2025.12 | 63.2 | |
| Claude 3.5 SonnetOpen Data=false, Super-Image (SI)=false2025.12 | 60.1 |