Video Question Answering on VideoMME 16 (test)
70.11Medium Length ScoreDIG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 70.11 | 63.42 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 69.89 | 61 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 69.56 | 62 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 69 | 62.29 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 68.89 | 59.67 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 68.33 | 61.44 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 68.22 | 54.41 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 68.21 | 59.28 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 68 | 58.24 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 67.66 | 57.76 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 67.56 | 55.11 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 67.01 | 55.82 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 66.78 | 55.69 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 66.31 | 57.12 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 66.24 | 58.19 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 65.91 | 54.81 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 65.89 | 54.84 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 65.67 | 55.93 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 64.67 | 58.44 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 64.33 | 55.67 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 62.94 | 53.44 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 62.8 | 57.72 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 62.61 | 55.3 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 61.62 | 53.24 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 61.32 | 53.7 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 61.01 | 51.27 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 60.87 | 57.76 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 60.43 | 55.9 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 59.89 | 56 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 59.22 | 53.11 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 59.08 | 52.02 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 58.62 | 52.18 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 57.89 | 53.33 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 56.81 | 51.93 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 56.64 | 51.57 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 55.94 | 48.12 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 55.44 | 53.33 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 55.09 | 51.11 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 54.23 | 46.88 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 54.12 | 51.21 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 54.03 | 49.63 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 53.89 | 51.56 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 53.78 | 49.02 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 51.36 | 45.84 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 50.81 | 49.21 |