Offline Video Understanding on VideoMME w/o sub. (Segmented by Length)
65.3Accuracy (Overall)FluxMem
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FluxMemSize=7B, Frames=1 fps2026.03 | 65.3 | 76.9 | 65.1 | 54 | |
| Qwen2.5-VLSize=7B, Frames=7682026.03 | 65.1 | — | — | — | |
| InternVL2.5Size=8B, Frames=642026.03 | 64.2 | — | — | — | |
| LLaVA-VideoSize=7B, Frames=1 fps2026.03 | 63.3 | — | — | — | |
| TimeChat-OnlineSize=7B, Frames=1 fps2026.03 | 63.3 | — | — | 52.4 | |
| Qwen2.5-VL†Size=7B, Frames=1 fps2026.03 | 63.3 | 73.8 | 62.4 | 53.8 | |
| StreamMemSize=7B, Frames=4.0/0.5 fps2026.03 | 62.1 | 71.5 | 62.4 | 52.3 | |
| StreamForestSize=7B, Frames=1 fps2026.03 | 61.9 | — | — | — | |
| Flash-VStreamSize=7B, Frames=1 fps2026.03 | 61.2 | 72 | 61.1 | 50.3 | |
| LongVUSize=7B, Frames=1 fps2026.03 | 60.6 | — | — | — | |
| LLaVA-OneVisionSize=7B, Frames=322026.03 | 58.4 | 70.1 | 56.4 | 48.8 | |
| LiveVLMSize=7B, Frames=0.5/0.2 fps2026.03 | 57.3 | 66.7 | 56.4 | 48.8 | |
| DispiderSize=7B, Frames=1 fps2026.03 | 57.2 | — | 53.7 | 49.7 | |
| VideoChat-OnlineSize=4B, Frames=2 fps2026.03 | 52.8 | — | — | 44.9 | |
| LongVASize=7B, Frames=1282026.03 | 52.6 | 61.1 | 50.4 | 46.2 | |
| MovieChatSize=7B, Frames=20482026.03 | 38.2 | — | — | 33.4 |