Ambiguous Question Answering on Museum Artifact Dataset Amb. 1.0 (test)
65Answer AccuracyQwen3-VL-8B (Direct)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-VL-8B (Direct)search=disabled, reliability control=none2026.07 | 65 | 33 | 67 | 3.33 | |
| VaseAgent (w/o GRPO)search=enabled, reliability control=source/response control, GRPO selection=disabled2026.07 | 55 | 46 | 54 | 2.84 | |
| VaseAgent (Full)search=enabled, reliability control=complete system, GRPO selection=enabled2026.07 | 55 | 44 | 56 | 3.02 | |
| Qwen3-VL-8B + Searchsearch=enabled, reliability control=none2026.07 | 48 | 53 | 46 | 2.64 |