List your company
ResearchFormerly WizWand

Visual Question Answering on MMHalSnowball CleanConv 1.0

77.94AccuracyQwen-VL-Chat
31.826443.798255.7767.7418Jun 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Qwen-VL-ChatPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0677.94
CogVLMPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0675.17
CogVLMPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0672.69
ShareGPT4VPrompt Type=Formatting Prompt, Model Scale=13B, Zero-shot=true2024.0672.43
LLaVA-1.5Prompt Type=Formatting Prompt, Model Scale=13B, Zero-shot=true2024.0672.07
ShareGPT4VPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0671.81
LLaVA-1.5Prompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0671.24
ShareGPT4VPrompt Type=Question Prompt, Model Scale=13B, Zero-shot=true2024.0664.71
MiniGPT-v2Prompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0662.12
LLaVA-1.5Prompt Type=Question Prompt, Model Scale=13B, Zero-shot=true2024.0662.03
ShareGPT4VPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0661.81
LLaVA-1.5Prompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0661.21
InstructBLIPPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0660.61
GPT-4VPrompt Type=Formatting Prompt, Model Scale=Closed-Source, Zero-shot=true2024.0660.49
mPLUG-Owl2Prompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0660.47
InstructBLIPPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0659.88
MiniGPT-v2Prompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0659.24
InstructBLIPPrompt Type=Question Prompt, Model Scale=13B, Zero-shot=true2024.0655.02
mPLUG-Owl2Prompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0654.88
InstructBLIPPrompt Type=Formatting Prompt, Model Scale=13B, Zero-shot=true2024.0653.53
OtterPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0652.12
GPT-4VPrompt Type=Question Prompt, Model Scale=Closed-Source, Zero-shot=true2024.0652.02
Qwen-VL-ChatPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0651.8
OtterPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0644.9
InternLM-XCPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0643.51
IDEFICSPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0641.22
IDEFICSPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0640.94
InternLM-XCPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0640.84
mPLUG-OwlPrompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0637.8
mPLUG-OwlPrompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0637.18
MiniGPT-4Prompt Type=Formatting Prompt, Model Scale=7B, Zero-shot=true2024.0637.12
MiniGPT-4Prompt Type=Question Prompt, Model Scale=7B, Zero-shot=true2024.0633.6