Multimodal Reasoning on M3-Bench web
46.4ME ScoreM3-Agent + StreamMeCo + TMR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| M3-Agent + StreamMeCo + TMRModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 46.4 | 32.2 | 46.5 | 61.8 | 55.8 | 50.7 | |
| M3-Agent + StreamMeCo + TMRModel Category=Streaming Video Models, Compression Ratio=50%2026.04 | 45.4 | 31.3 | 45 | 59.2 | 52.7 | 48.9 | |
| M3-AgentModel Category=Streaming Video Models2026.04 | 44.9 | 25.6 | 44.8 | 58.6 | 53.7 | 47.9 | |
| M3-Agent + StreamMeCo + TMRModel Category=Streaming Video Models, Compression Ratio=70%2026.04 | 43.8 | 28.9 | 43.9 | 57.9 | 52.9 | 47.9 | |
| M3-Agent + RandomModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 42.4 | 24.7 | 40.1 | 54.8 | 50.8 | 44.6 | |
| M3-Agent + StreamMeCoModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 41.3 | 26 | 44.3 | 58.3 | 50.5 | 47 | |
| M3-Agent + ClusteringModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 41.2 | 26.3 | 41.7 | 55.9 | 50.9 | 45.3 | |
| M3-Agent + DARTModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 40.4 | 26 | 41.3 | 55.6 | 51.2 | 45.4 | |
| M3-Agent + TimeChat-MemoryModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 39.8 | 27.1 | 38.9 | 56.6 | 46.7 | 44.7 | |
| M3-Agent + StreamMeCoModel Category=Streaming Video Models, Compression Ratio=50%2026.04 | 39.7 | 25.2 | 38.9 | 58.4 | 47.3 | 44.7 | |
| TimeChat-OnlineModel Category=Streaming Video Models2026.04 | 38.8 | 22.8 | 38.4 | 51.6 | 28 | 36.6 | |
| M3-Agent + MemoryLLMModel Category=Streaming Video Models, Compression Ratio=30%2026.04 | 38.4 | 24.9 | 36.6 | 56.5 | 45.4 | 44.5 | |
| StreamForestModel Category=Streaming Video Models2026.04 | 37.9 | 22.3 | 39.9 | 51.7 | 27.6 | 36.5 | |
| M3-Agent + StreamMeCoModel Category=Streaming Video Models, Compression Ratio=70%2026.04 | 37 | 21.7 | 36.1 | 53 | 46.3 | 41.9 | |
| Gemini-GPT4o-HybridModel Category=Closed-source MLLMs2026.04 | 35.9 | 26.2 | 37.6 | 43.8 | 52.2 | 41.2 | |
| VideoChat-OnlineModel Category=Streaming Video Models2026.04 | 34.3 | 18.9 | 34.1 | 48.3 | 23.1 | 32.7 | |
| Gemini-AgentModel Category=Closed-source MLLMs2026.04 | 29.3 | 20.9 | 33.8 | 34.6 | 45 | 34.1 | |
| MA-LMMModel Category=Streaming Video Models2026.04 | 26.8 | 10.5 | 22.4 | 39.3 | 15.8 | 24.3 | |
| Flash-VStreamModel Category=Streaming Video Models2026.04 | 24.5 | 10.3 | 24.6 | 32.5 | 20.2 | 23.6 | |
| GPT-4oModel Category=Closed-source MLLMs2026.04 | 21.3 | 21.9 | 30.9 | 27.1 | 39.6 | 28.7 | |
| Gemini-1.5-ProModel Category=Closed-source MLLMs2026.04 | 18 | 17.9 | 23.8 | 23.1 | 28.7 | 23.2 | |
| MovieChatModel Category=Streaming Video Models2026.04 | 12.2 | 6.6 | 12.5 | 17.4 | 11.1 | 12.6 | |
| Qwen2.5-VL-7b-InstructModel Category=Open-source MLLMs2026.04 | 11.9 | 10.5 | 13.4 | 14 | 20.9 | 14.9 | |
| Qwen2.5-Omni-7bModel Category=Open-source MLLMs2026.04 | 8.9 | 8.8 | 13.7 | 10.8 | 14.1 | 11.3 |