List your company
ResearchFormerly WizWand

Multi-modal Evaluation on MME (total)

2,433.61MME Total ScoreQwen-VL-Max
-48.7244595.72781,240.181,884.6322May 22, 2024Sep 2, 2024Dec 15, 2024Mar 29, 2025Jul 11, 2025Oct 23, 2025Feb 4, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Qwen-VL-Max2024.052,433.61
GPT-4oindependent reproduction=true, IoT prompting=true2024.052,396.1
GPT-4oindependent reproduction=true, IoT prompting=false2024.052,254.1
InternLM-XComposer2-VLParams=7B2024.052,242.71
Qwen-VL-Plus2024.052,183.39
NextFlow#Training Data=40M, Model Size=7B2026.011,897.7
LLaVA 1.5#Training Data=0.7M, Model Size=13B2026.011,826.7
NextFlow#Training Data=0.7M, Model Size=7B2026.011,752.1
NextFlow#Training Data=21M, Model Size=7B2026.011,744.9
MAPBackbone=InternVL32025.081,737
VanillaBackbone=InternVL32025.081,729.6
DCLABackbone=InternVL32025.081,726.4
DAMOBackbone=InternVL32025.081,725.8
SPINBackbone=InternVL32025.081,722.8
MAPBackbone=QwenVL2.52025.081,712
DAMOBackbone=InternVL2.52025.081,709.9
MAPBackbone=InternVL2.52025.081,704.3
VanillaBackbone=QwenVL2.52025.081,704.2
DCLABackbone=QwenVL2.52025.081,704
DAMOBackbone=QwenVL2.52025.081,699.9
VanillaBackbone=InternVL2.52025.081,697.2
DCLABackbone=InternVL2.52025.081,694.6
SPINBackbone=QwenVL2.52025.081,686.3
Gemini-Pro-1.5independent reproduction=true, IoT prompting=true2024.051,686.1
SPINBackbone=InternVL2.52025.081,685.2
LLaVA-v1.5-13BParams=13.4B2024.051,615.6
Gemini-Pro-1.5independent reproduction=true, IoT prompting=false2024.051,571.4
LLaVA-1.5-7BReduction Ratio=0%, Vision Tokens=5762026.021,510.7
MQTReduction Ratio=88%, Vision Tokens=642026.021,464.3
M3Reduction Ratio=75%, Vision Tokens=362026.021,417.2
MQTReduction Ratio=88%, Vision Tokens=362026.021,416.3
Mask-LLaVAReduction Ratio=90%, Vision Tokens=572026.021,415
MQTReduction Ratio=88%, Vision Tokens=162026.021,408.5
Mask-LLaVAReduction Ratio=97%, Vision Tokens=422026.021,402.7
Mask-LLaVAReduction Ratio=97%, Vision Tokens=152026.021,395.8
M3Reduction Ratio=75%, Vision Tokens=92026.021,374.8
FasterVLMReduction Ratio=90%, Vision Tokens=582026.021,348.6
FasterVLMReduction Ratio=95%, Vision Tokens=292026.021,254.8
LLaVA-1.5-7B (Random Patch Dropping)Reduction Ratio=90%, Vision Tokens=582026.021,246.8
FitPruneReduction Ratio=90%, Vision Tokens=582026.021,147.4
LLaVA-1.5-7B (Random Patch Dropping)Reduction Ratio=95%, Vision Tokens=292026.021,141.1
SparseVLMReduction Ratio=90%, Vision Tokens=582026.021,030.6
FitPruneReduction Ratio=95%, Vision Tokens=292026.02855.2
MiniGPT-4Params=8B2024.05725.95
AdaMMSmerging_target=Qwen2-VL-7B, merging_source=LLaVA-OneVision-7B2025.0383.36
Ties-Mergingmerging_target=Qwen2-VL-7B, merging_source=LLaVA-OneVision-7B2025.0382.65
Task Arithmeticmerging_target=Qwen2-VL-7B, merging_source=LLaVA-OneVision-7B2025.0382.33
Qwen2-VL (base)model_status=Original Model2025.0381.44
MetaGPTmerging_target=Qwen2-VL-7B, merging_source=LLaVA-OneVision-7B2025.0381.21
LLaVA-OneVisionmodel_status=Original Model2025.0377.04
AdaMMSMerging Protocol=AdaMMS2025.0369.09
LLaVA-v1.5-7BStatus=Source Model2025.0366.68
LLaVAMethod Category=Original Model2025.0366.68
DARE-Linearmerging_target=Qwen2-VL-7B, merging_source=LLaVA-OneVision-7B2025.0366.06
Task ArithmeticMerging Protocol=Task Arithmetic2025.0365.99
Task Arithmeticunsupervised=false2025.0364.65
AdaMMSunsupervised=true2025.0364.65
AdaMMSUnsupervised=true2025.0364.61
MetaGPTUnsupervised=true2025.0364.24
Ties-MergingUnsupervised=false2025.0364.2
DARE-LinearMerging Protocol=DARE-Linear2025.0364.08
Task ArithmeticUnsupervised=false2025.0363.17
DARE-LinearUnsupervised=false2025.0362.99
mPLUG-Owl2(base)2025.0362.8
mPLUG-Owl2(base)Method Category=Original Model2025.0362.8
DARE-Linearunsupervised=false2025.0362.44
DARE-TiesUnsupervised=false2025.0360.37
MetaGPTMerging Protocol=MetaGPT2025.0359.37
CogVLM-chat-7BStatus=Base Model2025.0359.23
CogVLM2025.0359.23
DARE-Tiesunsupervised=false2025.0357.9
Ties-MergingMerging Protocol=Ties-Merging2025.0357.29
MetaGPTunsupervised=true2025.0356.81
DARE-Tiesmerging_target=Qwen2-VL-7B, merging_source=LLaVA-OneVision-7B2025.0354.43
Ties-Mergingunsupervised=false2025.0348.96
DARE-TiesMerging Protocol=DARE-Ties2025.0346.75