Video Question Answering on MovieChat-1K Global Mode
3.28Correctness of InformationMovieChat+
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MovieChat+Text Decoder=LLM based2024.04 | 3.28 | 3.04 | 3.47 | 3.22 | 3.41 | |
| MovieChatText Decoder=LLM based2024.04 | 3.11 | 2.93 | 3.24 | 3.17 | 3.25 | |
| Video ChatText Decoder=LLM based2024.04 | 3.04 | 2.75 | 3.09 | 3 | 3.21 | |
| Video LLaMAText Decoder=LLM based2024.04 | 2.75 | 2.24 | 2.83 | 2.62 | 2.97 | |
| Video-ChatGPTText Decoder=LLM based2024.04 | 2.37 | 2.3 | 2.58 | 2.49 | 2.69 | |
| mPLUG-2Text Decoder=non-LLM based2024.04 | 1.82 | 1.93 | 2.24 | 1.92 | 2.35 | |
| GITText Decoder=non-LLM based2024.04 | 1.65 | 1.74 | 2 | 1.88 | 2.16 |