Visual Question Answering on Expert-constructed ICT objective questions (test)
82.5Precision (s)DICModel
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DICModelSize=7B2026.01 | 82.5 | 52 | 72.3 | |
| Qwen2.5-VLSize=32B2026.01 | 80 | 47 | 69 | |
| Intern2.5-VLSize=32B2026.01 | 79.5 | 55 | 71.3 | |
| Gemini 2.0Size=API2026.01 | 77.5 | 38 | 64.3 | |
| Qwen2.5-VLSize=7B2026.01 | 73 | 40 | 62 | |
| InternLM-XC-2.0Size=7B2026.01 | 71 | 39 | 60.3 | |
| Claude-3.5Size=API2026.01 | 67 | 37 | 57 | |
| Phi-3.5-visionSize=4B2026.01 | 48.5 | 10 | 35.7 | |
| LLAVA-1.5Size=7B2026.01 | 45 | 21 | 37 |