Video Question Answering on INST-IT Bench Video
81MC Q&A AccuracyGPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o#IT=N/A2024.12 | 81 | 65.5 | |
| Gemini-1.5-flash#IT=N/A2024.12 | 75.8 | 57.9 | |
| Qwen2-VL-InstructLLM=Qwen2-72B, #IT=N/A2024.12 | 74.6 | 45.5 | |
| LLaVA-NeXT-INST-ITLLM=Qwen2-7B, #IT=920K2024.12 | 53.3 | 45.7 | |
| LLaVA-VideoLLM=Qwen2-7B, #IT=~7.4M2024.12 | 53.2 | 34.1 | |
| LLaVA-OVLLM=Qwen2-7B, #IT=~8.8M2024.12 | 45.6 | 33.2 | |
| InternVL2LLM=InternLM2.5-7B, #IT=N/A2024.12 | 45.5 | 39.8 | |
| LLaVA-NeXT-INST-ITLLM=Vicuna-7B, #IT=920K2024.12 | 42.1 | 49.3 | |
| LLaVA-OV (SI)LLM=Qwen2-7B, #IT=~7.2M2024.12 | 36.4 | 31.4 | |
| Random Guess#IT=N/A2024.12 | 25 | — | |
| LLaVA-NeXT-VideoLLM=Vicuna-7B, #IT=860K2024.12 | 24.8 | 25.8 | |
| ShareGPT4VideoLLM=Llama3-8B, #IT=~1.0M2024.12 | 16.1 | 27.8 |