Visual Question Answering on VRQABench
72.4AccuracyPF-OPSD
Evaluation results
| Method | Links | |
|---|---|---|
| PF-OPSDProtocol=Qwen3.5-9B training baseline2026.06 | 72.4 | |
| GRPOProtocol=Qwen3.5-9B training baseline2026.06 | 63.5 | |
| SFTProtocol=Qwen3.5-9B training baseline2026.06 | 61.8 | |
| Workflow Agent (Gemini-3-Flash)Protocol=Workflow-agent2026.06 | 47.2 | |
| Gemini-3-FlashProtocol=Zero-shot / no-simulation2026.06 | 45.9 | |
| GPT-5.4Protocol=Zero-shot / no-simulation2026.06 | 43.2 | |
| HY3Protocol=Zero-shot / no-simulation2026.06 | 38.2 | |
| Qwen3.5-9BProtocol=Zero-shot / no-simulation2026.06 | 33.2 | |
| Qwen3.6-27BProtocol=Zero-shot / no-simulation2026.06 | 33 | |
| Qwen2.5-VL-7BProtocol=Zero-shot / no-simulation2026.06 | 32.7 | |
| Workflow Agent (Qwen3.5-9B)Protocol=Workflow-agent2026.06 | 32.6 |