Open-ended VQA on MMOral-X
43.16Simple ScoreOralGPT-Plus-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OralGPT-Plus-7BParams=7B2026.03 | 43.16 | 20.6 | 24.96 | |
| OralGPT-Plus-3BParams=3B2026.03 | 33.12 | 11.24 | 10.7 | |
| GPT-5Params=N/A2026.03 | 32.9 | 8.3 | 9.3 | |
| Claude-sonnet-4-5Params=N/A2026.03 | 27.72 | 8.14 | 9.78 | |
| Gemini-2.5-FlashParams=N/A2026.03 | 25.56 | 9.7 | 8.7 | |
| OralGPT-Plus-7B-SFTParams=7B2026.03 | 23.06 | 11.36 | 14.4 | |
| Doubao-seed-1-6Params=N/A2026.03 | 20.1 | 5.8 | 5.2 | |
| MedVLM-R1Params=2B2026.03 | 16.8 | 8.7 | 3.92 | |
| OralGPT-Plus-3B-SFTParams=3B2026.03 | 16.45 | 8.32 | 14.18 | |
| GLM-4.5vParams=106B2026.03 | 15.68 | 5.46 | 4.04 | |
| Grok-4Params=N/A2026.03 | 15.18 | 7.96 | 6.12 | |
| Qwen3-VL-235b-a22b-thinkingParams=235B2026.03 | 10.24 | 3.88 | 3.42 | |
| LLaVA-OneVisionParams=8B2026.03 | 8.66 | 3.62 | 6.08 | |
| MedGemma-4BParams=4B2026.03 | 8.48 | 1.06 | 3.72 | |
| Qwen2.5-VL-7B-InstructParams=7B2026.03 | 7.22 | 4.58 | 3.7 | |
| HuatuoGPT-VParams=34B2026.03 | 6.4 | 2.62 | 4.02 | |
| HealthGPTParams=32B2026.03 | 6.34 | 0.34 | 0.26 | |
| MedDrParams=40B2026.03 | 6.14 | 4.26 | 3.08 | |
| Mini-o3Params=7B2026.03 | 3.14 | 2.18 | 2.04 | |
| Qwen2.5-VL-3B-InstructParams=3B2026.03 | 1.82 | 4.96 | 3.4 | |
| LLaVA-MedParams=7B2026.03 | 0.2 | 0.16 | 0.1 |