List your company
ResearchFormerly WizWand

Multimodal Reasoning on LMMs-Eval Average

70.83Average AccuracyInternVL2-8B
36.520445.427754.33563.2423Nov 30, 2024
Updated 8mo ago

Evaluation results

MethodLinks
InternVL2-8BReduction Method=None (Base), Memory cost=1, TFLOPs=24.1, Time cost=1.5182024.1170.83
G-SearchBackbone=InternVL2-8B, Memory cost=0.424, TFLOPs=12.24, Time cost=0.862024.1170.1
FastVBackbone=InternVL2-8B, Filtering Ratio (R)=50%, Memory cost=0.531, TFLOPs=14.58, Time cost=0.9982024.1169.42
PDropBackbone=InternVL2-8B, Memory cost=0.469, TFLOPs=13.13, Time cost=0.9152024.1169.19
InternVL2-4BReduction Method=None (Base), Memory cost=1, TFLOPs=13.97, Time cost=0.9692024.1168.16
G-SearchBackbone=InternVL2-4B, Memory cost=0.488, TFLOPs=8.69, Time cost=0.6452024.1167.65
PDropBackbone=InternVL2-4B, Memory cost=0.469, TFLOPs=8.35, Time cost=0.6272024.1166.94
FastVBackbone=InternVL2-4B, Filtering Ratio (R)=50%, Memory cost=0.531, TFLOPs=9.01, Time cost=0.6522024.1166.19
InternVL2-2BReduction Method=None (Base), Memory cost=1, TFLOPs=8.1, Time cost=0.5982024.1161.94
G-SearchBackbone=InternVL2-2B, Memory cost=0.532, TFLOPs=5.64, Time cost=0.4442024.1161.22
FastVBackbone=InternVL2-2B, Filtering Ratio (R)=50%, Memory cost=0.542, TFLOPs=5.85, Time cost=0.4512024.1159.91
InternVL2-1BReduction Method=None (Base), Memory cost=1, TFLOPs=4.62, Time cost=0.3842024.1159.85
G-SearchBackbone=InternVL2-1B, Memory cost=0.527, TFLOPs=3.84, Time cost=0.3332024.1159.19
PDropBackbone=InternVL2-2B, Memory cost=0.583, TFLOPs=5.93, Time cost=0.4522024.1158.98
FastVBackbone=InternVL2-1B, Filtering Ratio (R)=50%, Memory cost=0.542, TFLOPs=3.91, Time cost=0.3422024.1154.85
PDropBackbone=InternVL2-1B, Memory cost=0.583, TFLOPs=3.88, Time cost=0.3362024.1153.7
VTWBackbone=InternVL2-8B, Memory cost=0.5, TFLOPs=13.71, Time cost=0.9272024.1152.51
VTWBackbone=InternVL2-4B, Memory cost=0.5, TFLOPs=8.72, Time cost=0.6492024.1149.01
LLaVA-1.5-7BReduction Method=None (Base), Memory cost=1, TFLOPs=9.18, Time cost=0.6252024.1148.97
G-SearchBackbone=LLaVA-1.5-7B, Memory cost=0.34, TFLOPs=3.95, Time cost=0.3012024.1148.77
PDropBackbone=LLaVA-1.5-7B, Memory cost=0.469, TFLOPs=5.47, Time cost=0.3812024.1148.7
FastVBackbone=LLaVA-1.5-7B, Filtering Ratio (R)=50%, Memory cost=0.531, TFLOPs=5.49, Time cost=0.3872024.1148.7
VTWBackbone=LLaVA-1.5-7B, Memory cost=0.5, TFLOPs=5.19, Time cost=0.3852024.1144.32
VTWBackbone=InternVL2-1B, Memory cost=0.5, TFLOPs=3.73, Time cost=0.3312024.1141.13
VTWBackbone=InternVL2-2B, Memory cost=0.5, TFLOPs=5.5, Time cost=0.4392024.1137.84