List your company

Multi-discipline Multimodal Understanding and Reasoning on MMMU

42.8Overall ScoreQwen2-VL-2B-Instruct (DPO, Full)
41.03241.49141.9542.409May 29, 2025

Evaluation results

MethodLinks
Qwen2-VL-2B-Instruct (DPO, Full)% Train=100, Train set=Full, Backbone=Qwen2-VL-2B-Instruct, Alignment Training Method=DPO2025.0542.8
Qwen2-VL-2B-Instruct (DPO, HighAvg.)% Train=33, Train set=HighAvg., Backbone=Qwen2-VL-2B-Instruct, Alignment Training Method=DPO2025.0542.6
Qwen2-VL-2B-Instruct (DPO, LowAvg.)% Train=33, Train set=LowAvg., Backbone=Qwen2-VL-2B-Instruct, Alignment Training Method=DPO2025.0542.2
Qwen2-VL-2B-Instruct (DPO, HighVar.)% Train=33, Train set=HighVar., Backbone=Qwen2-VL-2B-Instruct, Alignment Training Method=DPO2025.0542.1
Qwen2-VL-2B-Instruct (DPO, Random)% Train=33, Train set=Random, Backbone=Qwen2-VL-2B-Instruct, Alignment Training Method=DPO2025.0542
Qwen2-VL-2B-Instruct (Zeroshot)% Train=0, Train set=Zeroshot, Backbone=Qwen2-VL-2B-Instruct, Alignment Training Method=None2025.0541.1