Video Question Answering on VideoChatGPT (test)
2.96CILLAMA-VID
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLAMA-VIDLLM=Vicuna-7B, Backbone=ViT-G2024.11 | 2.96 | 3 | 3.53 | 2.46 | 2.51 | 2.89 | |
| ReWindLLM=LLaMA2-7B, Backbone=ViT-G2024.11 | 2.91 | 2.85 | 3.42 | 2.71 | 2.68 | 2.91 | |
| Chat-UniViLLM=Vicuna1.5-7B, Backbone=ViT-L2024.11 | 2.89 | 2.91 | 3.46 | 2.39 | 2.81 | 2.89 | |
| VTimeLLMLLM=Vicuna1.5-7B, Backbone=ViT-L2024.11 | 2.78 | 3.1 | 3.4 | 2.49 | 2.47 | 2.85 | |
| MovieChatLLM=LLaMA2-7B, Backbone=ViT-G2024.11 | 2.76 | 2.93 | 3.01 | 2.24 | 2.42 | 2.67 | |
| Video-ChatGPTLLM=Vicuna-7B, Backbone=ViT-L2024.11 | 2.4 | 2.52 | 2.62 | 1.98 | 2.37 | 2.38 | |
| Video ChatLLM=Vicuna-7B, Backbone=ViT-G2024.11 | 2.23 | 2.5 | 2.53 | 1.94 | 2.24 | 2.29 | |
| LLaMA-AdapterLLM=LLaMA-7B, Backbone=ViT-L2024.11 | 2.03 | 2.32 | 2.3 | 1.98 | 2.15 | 2.16 | |
| Video LLAMALLM=Vicuna-7B, Backbone=ViT-G2024.11 | 1.96 | 2.18 | 2.16 | 1.82 | 1.79 | 1.98 |