Video Question Answering on SEED-Bench (test)
31.04Procedure UnderstandingMovieChat+
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MovieChat+# Frames=256, Evaluation protocol=Zero-shot2024.04 | 31.04 | 42.45 | |
| MovieChat# Frames=256, Evaluation protocol=Zero-shot2024.04 | 29.82 | 40.11 | |
| MovieChat+# Frames=32, Evaluation protocol=Zero-shot2024.04 | 27.35 | 36.33 | |
| Video Chat# Frames=32, Evaluation protocol=Zero-shot2024.04 | 27.27 | 34.89 | |
| MovieChat# Frames=32, Evaluation protocol=Zero-shot2024.04 | 26.76 | 34.37 | |
| Video LLaMA# Frames=32, Evaluation protocol=Zero-shot2024.04 | 25.42 | 35.52 | |
| Video-ChatGPT# Frames=32, Evaluation protocol=Zero-shot2024.04 | 21.14 | 27.59 |