Video Question Answering on MovieChat 1K (test)
86.8AccuracySEAL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SEALEvaluation Protocol=Supervised2024.12 | 86.8 | 4.35 | |
| HERMESEvaluation Protocol=Supervised2024.12 | 84.9 | 4.4 | |
| TimeChat-HalEvaluation Protocol=Supervised2024.12 | 73.8 | 3.58 | |
| MovieChatEvaluation Protocol=Zero-shot2024.12 | 67.8 | 3.81 | |
| VideoChatEvaluation Protocol=Zero-shot2024.12 | 61 | 3.34 | |
| VideoLLaMAEvaluation Protocol=Zero-shot2024.12 | 51.4 | 3.1 | |
| Video-ChatGPTEvaluation Protocol=Zero-shot2024.12 | 44.2 | 2.71 |