Multimodal Video Comprehension on Video-MME
0Average SparsityFullAttention
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FullAttentionFPS=1fps, Model=Qwen2-VL-7B-Instruct, Subtitles=false2026.02 | 0 | 0.729 | 0.636 | 0.552 | 0.639 | |
| FullAttentionFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Subtitles=true2026.02 | 0 | 0.721 | 0.688 | 0.624 | 0.678 | |
| FlexPrefillFPS=1fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.99, Subtitles=false2026.02 | 17.8 | 0.724 | 0.636 | 0.558 | 0.639 | |
| FlexPrefillFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.99, Subtitles=true2026.02 | 28.8 | 0.717 | 0.684 | 0.619 | 0.673 | |
| RRAttentionFPS=1fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.95, Subtitles=false2026.02 | 34.7 | 0.726 | 0.64 | 0.562 | 0.643 | |
| RRAttentionFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.95, Subtitles=true2026.02 | 37.4 | 0.722 | 0.687 | 0.623 | 0.677 | |
| XAttentionFPS=1fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.95, Subtitles=false2026.02 | 37.5 | 0.727 | 0.636 | 0.561 | 0.641 | |
| XAttentionFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.95, Subtitles=true2026.02 | 39.9 | 0.723 | 0.689 | 0.623 | 0.679 | |
| FlexPrefillFPS=1fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.95, Subtitles=false2026.02 | 46.7 | 0.728 | 0.62 | 0.54 | 0.629 | |
| RRAttentionFPS=1fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.90, Subtitles=false2026.02 | 47 | 0.722 | 0.636 | 0.562 | 0.64 | |
| XAttentionFPS=1fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.90, Subtitles=false2026.02 | 49.3 | 0.718 | 0.628 | 0.557 | 0.634 | |
| RRAttentionFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.90, Subtitles=true2026.02 | 49.3 | 0.717 | 0.687 | 0.622 | 0.675 | |
| XAttentionFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.90, Subtitles=true2026.02 | 51.5 | 0.72 | 0.68 | 0.611 | 0.67 | |
| FlexPrefillFPS=0.5fps, Model=Qwen2-VL-7B-Instruct, Sparsity Threshold=0.95, Subtitles=true2026.02 | 58.6 | 0.708 | 0.67 | 0.594 | 0.657 |