Multimodal Multi-choice on RWQA
70.5AccuracySkiLa-V
Evaluation results
| Method | Links | |
|---|---|---|
| SkiLa-V2025.12 | 70.5 | |
| SkiLa2025.12 | 69.3 | |
| GPT-4o2025.12 | 68.6 | |
| Direct SFT2025.12 | 68.1 | |
| LVR 7B*Model Size=7B, Tested by authors=true2025.12 | 67.7 | |
| Qwen2.5-VL 7BModel Size=7B2025.12 | 67.4 | |
| GPT-4o-mini2025.12 | 67.1 | |
| Vision-R1 7B*Model Size=7B, Tested by authors=true2025.12 | 67.1 | |
| GPT-4v2025.12 | 63 | |
| Gemma3 27BModel Size=27B2025.12 | 62.5 | |
| ROSS 7BModel Size=7B2025.12 | 58.7 | |
| Cambrian 13BModel Size=13B2025.12 | 58.6 | |
| Claude3.7-Sonnet2025.12 | 55.4 | |
| Janus-Pro 7BModel Size=7B2025.12 | 42.7 |