Open-ended Video Question Answering on MovieChat-1K Global mode
93.1AccuracyDrVideo
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DrVideoArchitecture=Based on Open-source Captioners and Proprietary LLMs2024.06 | 93.1 | 4.41 | |
| Sullam Jeoung, et alArchitecture=Based on Open-source Captioners and Proprietary LLMs2024.06 | 84.8 | — | |
| MovieChat+Architecture=Open-Source MLLM2024.06 | 71.2 | 3.51 | |
| MovieChatArchitecture=Open-Source MLLM2024.06 | 68.3 | 3.15 | |
| VideoAgentArchitecture=Based on Open-source Captioners and Proprietary LLMs, re-implemented=true2024.06 | 65.4 | 3.12 | |
| MM-VIDArchitecture=Based on Open-source Captioners and Proprietary LLMs2024.06 | 58.6 | 2.86 | |
| LLoViArchitecture=Based on Open-source Captioners and Proprietary LLMs2024.06 | 58.3 | 2.87 | |
| Video ChatArchitecture=Open-Source MLLM2024.06 | 57.8 | 3.08 | |
| Video LLaMAArchitecture=Open-Source MLLM2024.06 | 51.7 | 2.72 | |
| Video-ChatGPTArchitecture=Open-Source MLLM2024.06 | 47.6 | 2.89 |