Video Question Answering on MLVU 78 (test)
76.66AccuracyDIG
Evaluation Results
| Method | Links | |
|---|---|---|
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 76.66 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 75.2 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 74.19 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 73.46 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 72.77 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 72.46 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 72.32 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 71.76 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 71.5 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 71.4 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 70.69 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 70.65 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 70.24 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 70.1 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 69.93 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 69.41 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 69.15 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 69.03 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 68.68 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 68.03 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 67.31 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 67.2 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 66.59 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 66.42 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 66.24 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 66.21 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 66.05 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 65.07 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 63.98 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 63.61 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 63.43 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 61.91 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 61.55 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 60.95 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 60.03 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 59.52 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 58.79 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 58.64 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 57.73 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 56.81 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 56.43 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 56.03 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 55.93 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 54.42 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 53.64 |