List your company

General Visual Question Answering on MMVP (Pass@1)

70.7Pass@1Seed 1.5-VL
66.5467.6268.769.78May 11, 2025

Evaluation results

MethodLinks
Seed 1.5-VLthinking=false, decoding=greedy2025.0570.7
Gemini 1.5 Prothinking=true, decoding=greedy2025.0570.7
GPT-4othinking=false, decoding=greedy2025.0570.7
Seed 1.5-VLthinking=true, decoding=greedy2025.0569.3
Qwen 2.5-VL 72Bthinking=false, decoding=greedy2025.0566.7