Video Question Answering on LongVideoBench (LVB) 58 (test)
66.42AccuracyDIG
Evaluation Results
| Method | Links | |
|---|---|---|
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 66.42 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 65.6 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 64.62 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 64.32 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 63.8 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 63.65 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 63.13 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1922025.12 | 62.45 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 62 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 61.93 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 61.86 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 61.86 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 61.78 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 61.48 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 61.41 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 61.41 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1922025.12 | 61.26 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=2562025.12 | 61.03 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 60.66 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 60.43 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 60.36 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=1282025.12 | 60.06 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=1282025.12 | 59.76 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 59.61 | |
| AKSBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 59.31 | |
| AKSBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 59.31 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=642025.12 | 59.01 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 58.94 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 58.86 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 57.89 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 57.89 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=642025.12 | 57.52 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=322025.12 | 57.37 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 57.37 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 56.92 | |
| DIGBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 56.77 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 56.62 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=322025.12 | 56.39 | |
| DIGBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 55.2 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=162025.12 | 54.67 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=162025.12 | 54.45 | |
| Q-FrameBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 54.23 | |
| Q-FrameBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 53.78 | |
| UNIBase LMM=Qwen2.5-VL-32B, Frame Count=82025.12 | 53.4 | |
| UNIBase LMM=Qwen2.5-VL-7B, Frame Count=82025.12 | 51.23 |