List your company
ResearchFormerly WizWand

Multimodal Understanding on MME (sum)

2,494.5Sum ScoreInternVL2.5-78B
1,395.741,680.9951,966.252,251.505Dec 6, 2024Dec 7, 2024Dec 8, 2024Dec 9, 2024
Updated 7mo ago

Evaluation results

MethodLinks
InternVL2.5-78BModel Name=InternVL2.5-78B2024.122,494.5
Qwen2-VL-72BModel Name=Qwen2-VL-72B2024.122,482.7
InternVL2.5-38BModel Name=InternVL2.5-38B2024.122,455.8
InternVL2-Llama3-76BModel Name=InternVL2-Llama3-76B2024.122,414.7
InternVL2.5-26BModel Name=InternVL2.5-26B2024.122,373.3
MiniCPM-V2.6Model Name=MiniCPM-V2.62024.122,348.4
VanillaMode=Upper bound2024.122,347
InternVL2.5-8BModel Name=InternVL2.5-8B2024.122,344.1
InternVL2.5-4BModel Name=InternVL2.5-4B2024.122,337.5
iLLaVAImage token reduction ratio=66.7%2024.122,328
Qwen2-VL-7BModel Name=Qwen2-VL-7B2024.122,326.8
InternVL2-40BModel Name=InternVL2-40B2024.122,307.5
SparseVLMImage token reduction ratio=66.7%2024.122,299
VisionZipImage token reduction ratio=66.7%2024.122,299
VisionZipImage token reduction ratio=77.8%2024.122,280
PyramidDropImage token reduction ratio=66.7%2024.122,267
iLLaVAImage token reduction ratio=77.8%2024.122,266
LLaVA-OneVision-72BModel Name=LLaVA-OneVision-72B2024.122,261
InternVL2-26BModel Name=InternVL2-26B2024.122,260.7
FasterVLMImage token reduction ratio=66.7%2024.122,258
InternVL2-8BModel Name=InternVL2-8B2024.122,210.3
FasterVLMImage token reduction ratio=77.8%2024.122,210
SparseVLMImage token reduction ratio=77.8%2024.122,208
iLLaVAImage token reduction ratio=88.9%2024.122,207
InternVL-Chat-V1.5Model Name=InternVL-Chat-V1.52024.122,194.2
PyramidDropImage token reduction ratio=77.8%2024.122,178
VisionZipImage token reduction ratio=88.9%2024.122,159
InternVL2.5-2BModel Name=InternVL2.5-2B2024.122,138.2
FasterVLMImage token reduction ratio=88.9%2024.122,131
SparseVLMImage token reduction ratio=88.9%2024.122,128
InternVL2-4BModel Name=InternVL2-4B2024.122,059.8
PyramidDropImage token reduction ratio=88.9%2024.122,039
InternVL2.5-1BModel Name=InternVL2.5-1B2024.121,950.5
GPT-4VModel Name=GPT-4V2024.121,926.6
InternVL2-2BModel Name=InternVL2-2B2024.121,876.8
Qwen2-VL-2BModel Name=Qwen2-VL-2B2024.121,872
InternVL2-1BModel Name=InternVL2-1B2024.121,794.4
Claude-3-OpusModel Name=Claude-3-Opus2024.121,586.8
LLaVA-OneVision-0.5BModel Name=LLaVA-OneVision-0.5B2024.121,438