Knowledge-Intensive Visual Question Answering on Museum Artifact Dataset V+K 1.0 (test)
69Answer AccuracyQwen3-VL-8B (Direct)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-VL-8B (Direct)search=disabled, reliability control=none2026.07 | 69 | 29 | 70 | 3.46 | |
| Qwen3-VL-8B + Searchsearch=enabled, reliability control=none2026.07 | 59 | 44 | 55 | 2.91 | |
| VaseAgent (Full)search=enabled, reliability control=complete system, GRPO selection=enabled2026.07 | 54 | 22 | 73 | 3.75 | |
| VaseAgent (w/o GRPO)search=enabled, reliability control=source/response control, GRPO selection=disabled2026.07 | 53 | 38 | 60 | 3.04 |