Scientific Multimodal MCQA on MAC
82.26AccuracySCICON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCICONBackbone=Qwen 3.5 9B2026.03 | 82.26 | 82.34 | |
| VCDBackbone=Qwen 3.5 9B2026.03 | 81.96 | 81.92 | |
| GreedyBackbone=Qwen 3.5 9B2026.03 | 81.35 | 81.4 | |
| ICDBackbone=Qwen 3.5 9B2026.03 | 81.04 | 81.01 | |
| SCICONBackbone=Qwen 3.5 4B2026.03 | 74.01 | 74.24 | |
| GreedyBackbone=Qwen 3.5 4B2026.03 | 69.72 | 70.75 | |
| VCDBackbone=Qwen 3.5 4B2026.03 | 68.5 | 68.77 | |
| ICDBackbone=Qwen 3.5 4B2026.03 | 58.41 | 58.57 | |
| SCICONBackbone=Phi-3.5-vision-instruct2026.03 | 49.54 | 49.89 | |
| VCDBackbone=Phi-3.5-vision-instruct2026.03 | 43.73 | 43.27 | |
| GreedyBackbone=Phi-3.5-vision-instruct2026.03 | 42.81 | 42.02 | |
| ICDBackbone=Phi-3.5-vision-instruct2026.03 | 42.81 | 41.6 |