Long-form Video Multimodal Evaluation on Video-MME Long
56.6Video-MME-Long ScoreM3-Agent + StreamMeCo + TMR
Evaluation results
| Method | Links | |
|---|---|---|
| M3-Agent + StreamMeCo + TMRModel Category=Streaming Video Models, Compression Ratio=50%2026.04 | 56.6 | |
| Gemini-GPT4o-HybridModel Category=Closed-source MLLMs2026.04 | 56.5 | |
| M3-AgentModel Category=Streaming Video Models2026.04 | 56 | |
| M3-Agent + StreamMeCo + TMRModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 55.2 | |
| Gemini-AgentModel Category=Closed-source MLLMs2026.04 | 55.1 | |
| M3-Agent + TimeChat-MemoryModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 55 | |
| M3-Agent + StreamMeCo + TMRModel Category=Streaming Video Models, Compression Ratio=70%2026.04 | 54.9 | |
| M3-Agent + DARTModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 54.8 | |
| M3-Agent + StreamMeCoModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 54.8 | |
| M3-Agent + ClusteringModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 54.6 | |
| M3-Agent + StreamMeCoModel Category=Streaming Video Models, Compression Ratio=50%2026.04 | 54.4 | |
| M3-Agent + RandomModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 54.2 | |
| M3-Agent + MemoryLLMModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 53.9 | |
| M3-Agent + StreamMeCoModel Category=Streaming Video Models, Compression Ratio=70%2026.04 | 53.3 | |
| StreamForestModel Category=Streaming Video Models2026.04 | 51.9 | |
| TimeChat-OnlineModel Category=Streaming Video Models2026.04 | 49.2 | |
| Qwen2.5-VL-7b-InstructModel Category=Open-source MLLMs2026.04 | 46.9 | |
| VideoChat-OnlineModel Category=Streaming Video Models2026.04 | 45.9 | |
| Qwen2.5-Omni-7bModel Category=Open-source MLLMs2026.04 | 42.2 | |
| GPT-4oModel Category=Closed-source MLLMs2026.04 | 38.8 | |
| Gemini-1.5-ProModel Category=Closed-source MLLMs2026.04 | 38 | |
| Flash-VStreamModel Category=Streaming Video Models2026.04 | 25 | |
| MovieChatModel Category=Streaming Video Models2026.04 | 19.4 | |
| MA-LMMModel Category=Streaming Video Models2026.04 | 17.3 |