Video Understanding on VideoMME (Performance, Latency, and Memory)
66.52VideoMME PerformanceOmniDrop
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| OmniDropModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=302026.05 | 66.52 | — | 1.05 | 1.15 | 25.65 | |
| OmniDropModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=202026.05 | 66.44 | -0.18 | 1.04 | 1.14 | 25.65 | |
| OmniZipModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=302026.05 | 65.85 | — | 1.06 | 1.15 | 25.76 | |
| DASHModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=302026.05 | 65.67 | — | 1.07 | 1.15 | 25.68 | |
| DASHModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=202026.05 | 64.96 | -1.09 | 1.02 | 1.11 | 25.65 | |
| OmniZipModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=202026.05 | 64.85 | -1.08 | 0.97 | 1.05 | 25.65 | |
| Qwen2.5-Omni-7BModel Backbone=Qwen2.5-Omni-7B, Retained Ratio (%)=1002026.05 | 64.67 | — | 1.73 | 1.82 | 28.92 | |
| OmniDropModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=302026.05 | 63.07 | — | 0.99 | 1.03 | 15.9 | |
| OmniDropModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=202026.05 | 63.07 | -0.47 | 0.97 | 1.02 | 15.9 | |
| OmniZipModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=302026.05 | 62.52 | — | 0.95 | 0.99 | 15.98 | |
| Qwen2.5-Omni-3BModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=1002026.05 | 62.51 | — | 1.35 | 1.4 | 18.63 | |
| DASHModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=302026.05 | 62.26 | — | 1.03 | 1.08 | 15.91 | |
| OmniZipModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=202026.05 | 61.59 | -0.98 | 0.94 | 0.98 | 15.91 | |
| DASHModel Backbone=Qwen2.5-Omni-3B, Retained Ratio (%)=202026.05 | 60.96 | -1.36 | 0.97 | 1.02 | 15.91 |