Visual Question Answering on Museum Artifact Dataset V-Only 1.0 (test)
44Accuracy (A)Qwen3-VL-8B (Direct)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-VL-8B (Direct)search=disabled, reliability control=none2026.07 | 44 | 54 | 45 | 2.83 | |
| VaseAgent (Full)search=enabled, reliability control=complete system, GRPO selection=enabled2026.07 | 24 | 66 | 34 | 2.47 | |
| Qwen3-VL-8B + Searchsearch=enabled, reliability control=none2026.07 | 20 | 79 | 20 | 1.86 | |
| VaseAgent (w/o GRPO)search=enabled, reliability control=source/response control, GRPO selection=disabled2026.07 | 20 | 76 | 24 | 2.18 |