Video Understanding on Video-MME (Video-MME↑, Avg.↑ (%))
81.4Video-MME ScoreContextGuard
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ContextGuardBackbone=Video-SALMONN2+ 7B, Comp.↑ (%)=552026.05 | 81.4 | 100.5 | |
| Full TokenBackbone=Video-SALMONN2+ 7B, Comp.↑ (%)=02026.05 | 79.2 | 100 | |
| FastVBackbone=Video-SALMONN2+ 7B, Comp.↑ (%)=502026.05 | 79.2 | 92.8 | |
| OmniZipBackbone=Video-SALMONN2+ 7B, Comp.↑ (%)=492026.05 | 79.2 | 95.7 | |
| Full TokenBackbone=Qwen2.5-Omni 7B, Comp.↑ (%)=02026.05 | 78.8 | 100 | |
| ContextGuardBackbone=Qwen2.5-Omni 7B, Comp.↑ (%)=552026.05 | 78.8 | 100 | |
| RandomBackbone=Qwen2.5-Omni 7B, Comp.↑ (%)=502026.05 | 78.4 | 95.4 | |
| FastVBackbone=Qwen2.5-Omni 7B, Comp.↑ (%)=502026.05 | 77.9 | 98.1 | |
| OmniZipBackbone=Qwen2.5-Omni 7B, Comp.↑ (%)=542026.05 | 77.1 | 97.3 | |
| RandomBackbone=Video-SALMONN2+ 7B, Comp.↑ (%)=502026.05 | 76.2 | 90.7 | |
| Full TokenBackbone=Video-SALMONN2+ 3B, Comp.↑ (%)=02026.05 | 76.2 | 100 | |
| Full TokenBackbone=Qwen2.5-Omni 3B, Comp.↑ (%)=02026.05 | 75.8 | 100 | |
| ContextGuardBackbone=Qwen2.5-Omni 3B, Comp.↑ (%)=612026.05 | 75.8 | 100.5 | |
| OmniZipBackbone=Qwen2.5-Omni 3B, Comp.↑ (%)=542026.05 | 74.9 | 98.9 | |
| RandomBackbone=Qwen2.5-Omni 3B, Comp.↑ (%)=502026.05 | 74 | 95.7 | |
| FastVBackbone=Qwen2.5-Omni 3B, Comp.↑ (%)=502026.05 | 74 | 98.2 | |
| ContextGuardBackbone=Video-SALMONN2+ 3B, Comp.↑ (%)=562026.05 | 73.6 | 96.9 | |
| RandomBackbone=Video-SALMONN2+ 3B, Comp.↑ (%)=502026.05 | 73.2 | 90.6 | |
| OmniZipBackbone=Video-SALMONN2+ 3B, Comp.↑ (%)=492026.05 | 73.2 | 93.7 | |
| FastVBackbone=Video-SALMONN2+ 3B, Comp.↑ (%)=502026.05 | 71 | 90.2 |