Scientific Multimodal MCQA on MMSci
52.71AccuracySCICON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCICONBackbone=Phi-3.5-vision-instruct2026.03 | 52.71 | 29.93 | |
| SCICONBackbone=Qwen 3.5 9B2026.03 | 52.14 | 33.91 | |
| VCDBackbone=Phi-3.5-vision-instruct2026.03 | 51.95 | 34.59 | |
| VCDBackbone=Qwen 3.5 9B2026.03 | 49.29 | 32.35 | |
| GreedyBackbone=Phi-3.5-vision-instruct2026.03 | 47.78 | 34.43 | |
| ICDBackbone=Qwen 3.5 9B2026.03 | 46.65 | 24.14 | |
| GreedyBackbone=Qwen 3.5 9B2026.03 | 46.54 | 27.34 | |
| ICDBackbone=Phi-3.5-vision-instruct2026.03 | 46.32 | 31.38 | |
| SCICONBackbone=Qwen 3.5 4B2026.03 | 43.44 | 19.06 | |
| VCDBackbone=Qwen 3.5 4B2026.03 | 40.85 | 26.58 | |
| GreedyBackbone=Qwen 3.5 4B2026.03 | 38.83 | 19.41 | |
| ICDBackbone=Qwen 3.5 4B2026.03 | 33.79 | 14.83 |