List your company
ResearchFormerly WizWand

Object Visual Question Answering (Multiple Choice) on RIO-Bench Obj-VQA (MC) Clean

98.4AccuracyIT-RT
85.60888.92992.2595.571Dec 10, 2025
Updated 8mo ago

Evaluation results

MethodLinks
IT-RTBackbone=Qwen-2.5-VL-7B, Category=text-agnostic2025.1298.4
IT-RTBackbone=Qwen2.5-VL-7B, Training Strategy=IT-RT2025.1298.4
RIO-RTBackbone=Qwen-3-VL-7B, Category=selective2025.1298.1
IT-RTBackbone=Llama-3.2-Vision-11B, Category=text-agnostic2025.1298.1
IT-RTBackbone=Llama-3.2-11B-Vision, Training Strategy=IT-RT2025.1298.1
RIO-RTBackbone=Qwen-2.5-VL-7B, Category=selective2025.1298
RIO-RTBackbone=Qwen2.5-VL-7B, Training Strategy=RIO-RT2025.1298
IT-RTBackbone=Qwen-3-VL-7B, Category=text-agnostic2025.1297.9
IT-RTBackbone=Llava-1.5-7B, Category=text-agnostic2025.1297.6
RIO-RTBackbone=Llama-3.2-Vision-11B, Category=selective2025.1297.6
IT-RTBackbone=LLaVA-1.5-7B, Training Strategy=IT-RT2025.1297.6
RIO-RTBackbone=Llama-3.2-11B-Vision, Training Strategy=RIO-RT2025.1297.6
RIO-RTBackbone=Llava-1.5-7B, Category=selective2025.1297.4
RIO-RTBackbone=LLaVA-1.5-7B, Training Strategy=RIO-RT2025.1297.4
RIO-RTBackbone=Llava-1.5-13B, Category=selective2025.1297.2
RIO-RTBackbone=LLaVA-1.5-13B, Training Strategy=RIO-RT2025.1297.2
pretrainedBackbone=Qwen-2.5-VL-7B2025.1296.9
pretrainedBackbone=Qwen2.5-VL-7B, Training Strategy=pretrained2025.1296.9
IT-RTBackbone=Llava-1.5-13B, Category=text-agnostic2025.1296.8
IT-RTBackbone=LLaVA-1.5-13B, Training Strategy=IT-RT2025.1296.8
CoT-defenseBackbone=Qwen-2.5-VL-7B, Category=text-agnostic2025.1296.6
CoTBackbone=Qwen2.5-VL-7B, Training Strategy=CoT2025.1296.6
CoT-defenseBackbone=Qwen-3-VL-7B, Category=text-agnostic2025.1296.2
pretrainedBackbone=Qwen-3-VL-7B2025.1296.1
RIO-RTBackbone=SmolVLM-2B, Category=selective2025.1296
pretrainedBackbone=Llama-3.2-Vision-11B2025.1295.5
pretrainedBackbone=Llama-3.2-11B-Vision, Training Strategy=pretrained2025.1295.5
IT-RTBackbone=SmolVLM-2B, Category=text-agnostic2025.1294.7
CoT-defenseBackbone=Llava-1.5-13B, Category=text-agnostic2025.1294.6
CoTBackbone=LLaVA-1.5-13B, Training Strategy=CoT2025.1294.6
pretrainedBackbone=Llava-1.5-7B2025.1293.5
pretrainedBackbone=LLaVA-1.5-7B, Training Strategy=pretrained2025.1293.5
CoT-defenseBackbone=Llama-3.2-Vision-11B, Category=text-agnostic2025.1293
CoTBackbone=Llama-3.2-11B-Vision, Training Strategy=CoT2025.1293
pretrainedBackbone=Llava-1.5-13B2025.1292.5
pretrainedBackbone=LLaVA-1.5-13B, Training Strategy=pretrained2025.1292.5
pretrainedBackbone=SmolVLM-2B2025.1292.1
CoT-defenseBackbone=SmolVLM-2B, Category=text-agnostic2025.1292.1
CoT-defenseBackbone=Llava-1.5-7B, Category=text-agnostic2025.1286.1
CoTBackbone=LLaVA-1.5-7B, Training Strategy=CoT2025.1286.1