Long Video Question Answering on EgoSchema (full set)
55.6AccuracyDispider
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DispiderLLM Size=7B, Frames=1 FPS2025.01 | 55.6 | — | |
| VideoChat2LLM Size=7B, Frames=162025.01 | 54.4 | — | |
| MovieChatLLM Size=7B, Frames=20482025.01 | 53.5 | — | |
| LLoViLM=GPT-3.5, Params=175B, Prompting Strategy=Summarization Prompt2023.12 | 52.2 | 2.31 | |
| Video-LLaMA2LLM Size=7B, Frames=162025.01 | 51.7 | — | |
| VamosLM=GPT-4, Params=1.5T2023.12 | 48.3 | — | |
| VLogLM=GPT-3.5, Params=175B2023.12 | 44 | 1.04 | |
| LLaVA-Next-VideoLLM Size=7B, Frames=322025.01 | 43.9 | — | |
| LLoViLM=GPT-3.5, Params=175B, Prompting Strategy=Standard Prompt2023.12 | 42.8 | 2.63 | |
| Video ChatCaptionerLM=GPT-3.5, Params=175B2023.12 | 39 | 1.24 | |
| LLaMA-VIDLLM Size=7B, Frames=1 FPS2025.01 | 38.5 | — | |
| Video-LLaVALLM Size=7B, Frames=82025.01 | 38.4 | — | |
| LongViViTLM=BERT, Params=1B2023.12 | 33.3 | — | |
| TimeChatLLM Size=7B, Frames=962025.01 | 33 | — | |
| InternVideoLM=Transformer, Params=478M2023.12 | 32.1 | — | |
| mPLUG-OwlLM=LLaMA, Params=7B2023.12 | 31.1 | — | |
| FrozenBiLMLM=DeBERTa, Params=300M2023.12 | 26.9 | — |