List your company
ResearchFormerly WizWand

Visual Question Answering on LLaVA-W

49.1ROUGE-LAIM-CoT
11.6621.3831.140.82Sep 30, 2025
Updated 6mo ago

Evaluation results

MethodLinks
AIM-CoTBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0949.1
AIM-CoTBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0946.5
ICoTBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0944.7
ICoTBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0943.4
CCoTBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0942.4
No-CoTBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0941.8
SCAFFOLDBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0941.5
DDCoTBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0941.3
No-CoTBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0940.5
SCAFFOLDBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0940.1
DDCoTBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0939.6
MMCoTBackbone=Qwen2.5-VL-32B, Shot=1-shot2025.0939.2
MMCoTBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0938.9
CCoTBackbone=Qwen2.5-VL-32B, Shot=0-shot2025.0937.8
AIM-CoTBackbone=Qwen2-VL-7B, Shot=1-shot2025.0937.3
AIM-CoTBackbone=Janus-Pro-7B, Shot=1-shot2025.0936.6
AIM-CoTBackbone=Qwen2-VL-7B, Shot=0-shot2025.0936.3
ICoTBackbone=Qwen2-VL-7B, Shot=1-shot2025.0935.7
AIM-CoTBackbone=Janus-Pro-7B, Shot=0-shot2025.0935.5
ICoTBackbone=Qwen2-VL-7B, Shot=0-shot2025.0934.2
CCoTBackbone=Qwen2-VL-7B, Shot=1-shot2025.0933.9
ICoTBackbone=Janus-Pro-7B, Shot=1-shot2025.0933.6
No-CoTBackbone=Qwen2-VL-7B, Shot=1-shot2025.0933.5
SCAFFOLDBackbone=Qwen2-VL-7B, Shot=1-shot2025.0933.1
DDCoTBackbone=Qwen2-VL-7B, Shot=1-shot2025.0932.8
No-CoTBackbone=Qwen2-VL-7B, Shot=0-shot2025.0932.7
ICoTBackbone=Janus-Pro-7B, Shot=0-shot2025.0932.5
AIM-CoTBackbone=Chameleon-7B, Shot=1-shot2025.0932
SCAFFOLDBackbone=Qwen2-VL-7B, Shot=0-shot2025.0931.8
CCoTBackbone=Janus-Pro-7B, Shot=1-shot2025.0931.5
MMCoTBackbone=Qwen2-VL-7B, Shot=1-shot2025.0931.4
DDCoTBackbone=Qwen2-VL-7B, Shot=0-shot2025.0931.2
No-CoTBackbone=Janus-Pro-7B, Shot=1-shot2025.0930.9
SCAFFOLDBackbone=Janus-Pro-7B, Shot=1-shot2025.0930.8
MMCoTBackbone=Qwen2-VL-7B, Shot=0-shot2025.0930.7
DDCoTBackbone=Janus-Pro-7B, Shot=1-shot2025.0930.4
AIM-CoTBackbone=Chameleon-7B, Shot=0-shot2025.0929.8
No-CoTBackbone=Janus-Pro-7B, Shot=0-shot2025.0929.8
SCAFFOLDBackbone=Janus-Pro-7B, Shot=0-shot2025.0929.7
CCoTBackbone=Qwen2-VL-7B, Shot=0-shot2025.0929.4
DDCoTBackbone=Janus-Pro-7B, Shot=0-shot2025.0929
MMCoTBackbone=Janus-Pro-7B, Shot=1-shot2025.0928.9
MMCoTBackbone=Janus-Pro-7B, Shot=0-shot2025.0928.2
CCoTBackbone=Janus-Pro-7B, Shot=0-shot2025.0927.8
ICoTBackbone=Chameleon-7B, Shot=1-shot2025.0927.6
ICoTBackbone=Chameleon-7B, Shot=0-shot2025.0925.2
SCAFFOLDBackbone=Chameleon-7B, Shot=1-shot2025.0924.7
CCoTBackbone=Chameleon-7B, Shot=1-shot2025.0924.5
No-CoTBackbone=Chameleon-7B, Shot=1-shot2025.0923.9
DDCoTBackbone=Chameleon-7B, Shot=1-shot2025.0923.1
CCoTBackbone=Chameleon-7B, Shot=0-shot2025.0922.1
SCAFFOLDBackbone=Chameleon-7B, Shot=0-shot2025.0921.7
MMCoTBackbone=Chameleon-7B, Shot=1-shot2025.0920.6
MMCoTBackbone=Chameleon-7B, Shot=0-shot2025.0920.4
DDCoTBackbone=Chameleon-7B, Shot=0-shot2025.0920.2
No-CoTBackbone=Chameleon-7B, Shot=0-shot2025.0913.1