List your company
ResearchFormerly WizWand

Video Question Answering on MLVU 78 (test)

76.66AccuracyDIG
52.719258.934665.1571.3654Dec 3, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.1276.66
DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.1275.2
DIGBase LMM=Qwen2.5-VL-32B, Frame Count=642025.1274.19
AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.1273.46
AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.1272.77
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.1272.46
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.1272.32
UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.1271.76
AKSBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.1271.5
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.1271.4
DIGBase LMM=Qwen2.5-VL-32B, Frame Count=322025.1270.69
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=642025.1270.65
UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.1270.24
Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.1270.1
AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.1269.93
AKSBase LMM=Qwen2.5-VL-32B, Frame Count=642025.1269.41
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.1269.15
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.1269.03
AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.1268.68
Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.1268.03
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.1267.31
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=322025.1267.2
AKSBase LMM=Qwen2.5-VL-7B, Frame Count=642025.1266.59
AKSBase LMM=Qwen2.5-VL-32B, Frame Count=322025.1266.42
UNIBase LMM=Qwen2.5-VL-32B, Frame Count=642025.1266.24
DIGBase LMM=Qwen2.5-VL-32B, Frame Count=162025.1266.21
Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=642025.1266.05
AKSBase LMM=Qwen2.5-VL-7B, Frame Count=322025.1265.07
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=162025.1263.98
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=642025.1263.61
Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=642025.1263.43
UNIBase LMM=Qwen2.5-VL-32B, Frame Count=322025.1261.91
DIGBase LMM=Qwen2.5-VL-32B, Frame Count=82025.1261.55
Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=322025.1260.95
Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=322025.1260.03
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=322025.1259.52
UNIBase LMM=Qwen2.5-VL-32B, Frame Count=162025.1258.79
DIGBase LMM=Qwen2.5-VL-7B, Frame Count=82025.1258.64
Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=162025.1257.73
Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=162025.1256.81
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=162025.1256.43
Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=82025.1256.03
UNIBase LMM=Qwen2.5-VL-32B, Frame Count=82025.1255.93
Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=82025.1254.42
UNIBase LMM=Qwen2.5-VL-7B, Frame Count=82025.1253.64