Video Question Answering on MovieChat-1k Global
84.9AccuracyHERMES
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HERMESEvaluation Protocol=Fully Supervised2024.08 | 84.9 | 4.4 | |
| HERMESEvaluation Protocol=Zero-shot2024.08 | 78.6 | 4.23 | |
| MovieChatEvaluation Protocol=Zero-shot2024.08 | 63.7 | 3.15 | |
| VideoChatEvaluation Protocol=Zero-shot2024.08 | 60.2 | 3.08 | |
| Video-ChatGPTEvaluation Protocol=Zero-shot2024.08 | 58.7 | 2.89 | |
| Video-LLaMAEvaluation Protocol=Zero-shot2024.08 | 56.3 | 2.72 |