Offline Video Understanding on VideoMME
71.9AccuracyGPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oModel Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 71.9 | |
| Gemini-1.5-ProModel Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 71.9 | |
| Qwen2.5-VLModel Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 65.1 | |
| InternVL2.5Model Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 64.2 | |
| LiveStarProModel Category=Online Assistants, Subtitles=w/o sub.2026.06 | 60.8 | |
| GPT-4VModel Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 59.9 | |
| LLaVA-OneVisionModel Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 58.2 | |
| DispiderModel Category=Online Assistants, Subtitles=w/o sub.2026.06 | 57.2 | |
| VideoChat-OnlineModel Category=Online Assistants, Subtitles=w/o sub.2026.06 | 52.8 | |
| VideoLLaMA2Model Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 47.9 | |
| LLaVA-NeXT-VideoModel Category=Offline Video-LLMs / LVLMs, Subtitles=w/o sub.2026.06 | 46.5 | |
| MovieChatModel Category=Online Assistants, Subtitles=w/o sub.2026.06 | 38.2 |