Video Question Answering on VideoMME (wo/w-subs)
75VQA Score (wo subs)Gemini-1.5-Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-1.5-ProFrames=568, Inference Time=198.8s2025.06 | 75 | 81.3 | — | |
| VideoChat-A1Backbone=InternVideo2.5-8B, Frames=41.3, Inference Time=28.4s2025.06 | 72.9 | 76.8 | — | |
| VideoChat-A1Backbone=InternVL2.5-8B, Frames=35.9, Inference Time=14.7s2025.06 | 72.3 | 77 | — | |
| GPT-4oFrames=384, Inference Time=134.4s2025.06 | 71.9 | 77.2 | — | |
| VideoChat-A1Backbone=Qwen2.5-VL-7B, Frames=42.0, Inference Time=18.6s2025.06 | 71.8 | 76.5 | — | |
| Qwen2.5-VL-72BFrames=768, Inference Time=122.4s2025.06 | 71.2 | 77.8 | — | |
| Bridge-STGModel Scale=7B-based2026.04 | 67.9 | 74.8 | — | |
| DyCokeBackbone=LLaVA-OV-72B, K=0.5, L=3, P=0.72024.11 | 66.3 | 69.7 | — | |
| OmniZipBackbone=Qwen2.5-Omni-7B, Retained Ratio=45%, FLOPs Ratio=39%2025.11 | 66.3 | — | 63 | |
| Full TokensBackbone=LLaVA-OV-72B2024.11 | 66.2 | 69.5 | — | |
| OmniZipBackbone=Qwen2.5-Omni-7B, Retained Ratio=35%, FLOPs Ratio=29%2025.11 | 66.1 | — | 61 | |
| Full TokensBackbone=Qwen2.5-Omni-7B, Retained Ratio=100%, FLOPs Ratio=100%2025.11 | 66 | — | 64.5 | |
| DyCoke (V&A)Backbone=Qwen2.5-Omni-7B, Retained Ratio=50%, FLOPs Ratio=44%2025.11 | 65.5 | — | 62 | |
| RandomBackbone=Qwen2.5-Omni-7B, Retained Ratio=55%, FLOPs Ratio=48%2025.11 | 65.4 | — | 61 | |
| DyCoke (V&A)Backbone=Qwen2.5-Omni-7B, Retained Ratio=35%, FLOPs Ratio=29%2025.11 | 65.2 | — | 57.4 | |
| InternVideo-2.5-8BFrames=512, Inference Time=33.8s2025.06 | 65.1 | — | — | |
| RandomBackbone=Qwen2.5-Omni-7B, Retained Ratio=40%, FLOPs Ratio=34%2025.11 | 65 | — | 56.9 | |
| DyCokeBackbone=LLaVA-OV-72B, K=0.7, L=3, P=0.72024.11 | 64.9 | 68.7 | — | |
| InternVL-2.5-8BFrames=64, Inference Time=12.4s2025.06 | 64.2 | 66.9 | — | |
| Qwen2.5-VL-7BFrames=512, Inference Time=24.3s2025.06 | 63.3 | 69.7 | — | |
| OmniZipBackbone=Qwen2.5-Omni-3B, Retained Ratio=45%, FLOPs Ratio=36%2025.11 | 62.8 | — | 61.3 | |
| OmniZipBackbone=Qwen2.5-Omni-3B, Retained Ratio=35%, FLOPs Ratio=26%2025.11 | 62.7 | — | 60.1 | |
| Full TokensBackbone=Qwen2.5-Omni-3B, Retained Ratio=100%, FLOPs Ratio=100%2025.11 | 62.6 | — | 62.2 | |
| FastVBackbone=LLaVA-OV-72B2024.11 | 62.1 | 66.7 | — | |
| PruMergeBackbone=LLaVA-OV-72B2024.11 | 61.9 | 63.8 | — | |
| DyCoke (V&A)Backbone=Qwen2.5-Omni-3B, Retained Ratio=50%, FLOPs Ratio=40%2025.11 | 61.6 | — | 60.7 | |
| RandomBackbone=Qwen2.5-Omni-3B, Retained Ratio=55%, FLOPs Ratio=45%2025.11 | 61.1 | — | 58.7 | |
| DyCoke (V&A)Backbone=Qwen2.5-Omni-3B, Retained Ratio=35%, FLOPs Ratio=26%2025.11 | 61 | — | 57.4 | |
| RandomBackbone=Qwen2.5-Omni-3B, Retained Ratio=40%, FLOPs Ratio=31%2025.11 | 60.6 | — | 57.5 | |
| SpaceVLLMModel Scale=7B-based2026.04 | 60 | 65.6 | — | |
| DyCokeBackbone=LLaVA-OV-7B, K=0.5, L=3, P=0.72024.11 | 59.5 | 61.4 | — | |
| DyCokeBackbone=LLaVA-OV-7B, K=0.3, L=3, P=0.72024.11 | 58.8 | 61 | — | |
| Full TokensBackbone=LLaVA-OV-7B2024.11 | 58.5 | 61.3 | — | |
| DyCokeBackbone=LLaVA-OV-7B, K=0.7, L=3, P=0.72024.11 | 58.3 | 60.7 | — | |
| LLaVA-OVModel Scale=7B-based2026.04 | 58.2 | 61.5 | — | |
| FastVBackbone=LLaVA-OV-7B2024.11 | 57.3 | 60.5 | — | |
| Videollama2.1Model Scale=7B-based2026.04 | 54.9 | 56.4 | — | |
| PruMergeBackbone=LLaVA-OV-7B2024.11 | 52.9 | 57 | — | |
| DyCokeBackbone=LLaVA-OV-0.5B, K=0.3, L=3, P=0.72024.11 | 45.4 | 43.8 | — | |
| DyCokeBackbone=LLaVA-OV-0.5B, K=0.7, L=3, P=0.72024.11 | 45.2 | 43.3 | — | |
| DyCokeBackbone=LLaVA-OV-0.5B, K=0.5, L=3, P=0.72024.11 | 45.1 | 43.4 | — | |
| Full TokensBackbone=LLaVA-OV-0.5B2024.11 | 44.1 | 43.5 | — | |
| FastVBackbone=LLaVA-OV-0.5B2024.11 | 42 | 41.4 | — | |
| Video-LLaVAModel Scale=7B-based2026.04 | 39.9 | 41.6 | — | |
| PruMergeBackbone=LLaVA-OV-0.5B2024.11 | 38.8 | 39.3 | — | |
| FastVBackbone=Qwen2.5-Omni-7B, Retained Ratio=50%, FLOPs Ratio=54%2025.11 | — | — | 58.4 | |
| FastVBackbone=Qwen2.5-Omni-7B, Retained Ratio=35%, FLOPs Ratio=42%2025.11 | — | — | 57.8 | |
| FastVBackbone=Qwen2.5-Omni-3B, Retained Ratio=50%, FLOPs Ratio=49%2025.11 | — | — | 55.9 | |
| FastVBackbone=Qwen2.5-Omni-3B, Retained Ratio=35%, FLOPs Ratio=37%2025.11 | — | — | 57.7 |