Video Question Answering on WorldSense (Category Metrics)
48.78Accuracy (Tech & Science)Full Tokens
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Full TokensBackbone=Qwen2.5-Omni-7B, Frame Budget=64, Retained Ratio=100%2026.05 | 48.78 | 41.2 | 45.39 | 44.85 | 47.04 | 41.16 | 51.46 | 44.19 | 45.71 | |
| Full TokensBackbone=Qwen2.5-Omni-7B, Frame Budget=32, Retained Ratio=100%2026.05 | 47.55 | 41.63 | 44.68 | 42.74 | 46.31 | 41.4 | 49.51 | 42.32 | 44.7 | |
| OmniZipBackbone=Qwen2.5-Omni-7B, Frame Budget=64, Retained Ratio=45%2026.05 | 47.14 | 39.48 | 44.53 | 40.63 | 47.54 | 40.93 | 46.93 | 43.07 | 44.1 | |
| OmniZipBackbone=Qwen2.5-Omni-7B, Frame Budget=32, Retained Ratio=45%2026.05 | 45.92 | 39.91 | 43.77 | 37.99 | 47.04 | 41.4 | 45.31 | 40.07 | 43.06 | |
| OmniSelectBackbone=Qwen2.5-Omni-7B, Frame Budget=64, Retained Ratio=45%2026.05 | 45.51 | 41.63 | 43.77 | 42.22 | 48.28 | 41.86 | 47.9 | 44.19 | 44.45 | |
| OmniSelectBackbone=Qwen2.5-Omni-7B, Frame Budget=64, Retained Ratio=30%2026.05 | 45.51 | 38.2 | 43.31 | 39.84 | 46.8 | 41.16 | 44.34 | 40.45 | 42.88 | |
| OmniZipBackbone=Qwen2.5-Omni-7B, Frame Budget=32, Retained Ratio=30%2026.05 | 45.1 | 40.34 | 40.43 | 38.52 | 46.8 | 38.6 | 42.07 | 38.58 | 41.49 | |
| OmniSelectBackbone=Qwen2.5-Omni-7B, Frame Budget=32, Retained Ratio=30%2026.05 | 45.1 | 36.91 | 41.34 | 38.52 | 45.32 | 41.16 | 44.66 | 38.95 | 41.87 | |
| OmniZipBackbone=Qwen2.5-Omni-7B, Frame Budget=64, Retained Ratio=30%2026.05 | 45.1 | 37.34 | 41.49 | 40.9 | 46.8 | 40.47 | 44.34 | 40.45 | 42.4 | |
| OmniSelectBackbone=Qwen2.5-Omni-7B, Frame Budget=32, Retained Ratio=45%2026.05 | 44.9 | 39.91 | 43.62 | 39.05 | 46.31 | 39.77 | 47.9 | 41.95 | 43.1 |