Video Question Answering on M3-Bench web
55.3MEHOMER
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HOMERMethod Category=Agent Method, Backbone=Gemini32026.07 | 55.3 | 42 | 50.7 | 65 | 59.1 | 56.4 | |
| M3-AgentMethod Category=Agent Method2026.07 | 45.9 | 28.4 | 44.3 | 59.3 | 53.9 | 48.9 | |
| M3-Agent-Gemini3Method Category=Agent Method, Backbone=Gemini32026.07 | 40.3 | 29.3 | 37.7 | 50.7 | 55.3 | 45.6 | |
| M3-Agent-Gemini25Method Category=Agent Method, Backbone=Gemini252026.07 | 37 | 26.5 | 39.2 | 47.9 | 53.1 | 43 | |
| Gemini-GPT-HybridMethod Category=Agent Method2026.07 | 35.9 | 26.2 | 37.6 | 43.8 | 52.2 | 41.2 | |
| Gemini-AgentMethod Category=Agent Method2026.07 | 29.3 | 20.9 | 33.8 | 34.6 | 45 | 34.1 | |
| MA-LMMMethod Category=Online Video Understanding2026.07 | 26.8 | 10.5 | 22.4 | 39.3 | 15.8 | 24.3 | |
| Flash-VStreamMethod Category=Online Video Understanding2026.07 | 24.5 | 10.3 | 24.6 | 32.5 | 20.2 | 23.6 | |
| MovieChatMethod Category=Online Video Understanding2026.07 | 12.2 | 6.6 | 12.5 | 17.4 | 11.1 | 12.6 |