Multiple-choice Video Question Answering on IntentQA (test)
66.9AccuracyVideoTree
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VideoTreeLLM Size=GPT-4, Vision Encoder=Unknown, Training Strategy=SFT2024.07 | 66.9 | — | — | — | — | |
| SF-LLaVA-34BLLM Size=34B, Vision Encoder=CLIP-L, Training Strategy=Training-free2024.07 | 66.5 | — | — | — | — | |
| LLaVA v1.6Vision Encoder=ViT-L, LLM Size=34B, Inference Vision=single, Inference LLM=single, Video Trained=false2024.03 | 65.3 | — | — | — | — | |
| IG-VLM (LLAVA-v1.6)LLM Size=34B, Vision Encoder=CLIP-L, Training Strategy=Training-free2024.07 | 65.3 | — | — | — | — | |
| GPT-4VVision Encoder=Unknown, LLM Size=GPT-4, Inference Vision=single, Inference LLM=single, Video Trained=false2024.03 | 64.2 | — | — | — | — | |
| LLoViVision Encoder=ViT-L, LLM Size=GPT-3.5, Inference Vision=multiple, Inference LLM=multiple, Video Trained=false2024.03 | 64 | — | — | — | — | |
| LLoViTraining Mode=Zero-shot2024.02 | 64 | — | — | — | — | |
| LLoViLLM Size=GPT-3.5, Vision Encoder=Unknown, Training Strategy=SFT2024.07 | 64 | — | — | — | — | |
| Q-ViDTraining Mode=Zero-shot2024.02 | 63.6 | — | — | — | — | |
| SeViLATraining Mode=Zero-shot2024.02 | 60.9 | — | — | — | — | |
| LLaVA v1.6Vision Encoder=ViT-L, LLM Size=7B, Inference Vision=single, Inference LLM=single, Video Trained=false2024.03 | 60.3 | — | — | — | — | |
| IG-VLM LLaVA v1.6Vision Encoder=ViT-L, LLM Size=7B, Inference Vision=single, Inference LLM=single, Video Trained=false2024.03 | 59.7 | — | — | — | — | |
| CaVIRTraining Mode=Supervised2024.02 | 57.6 | — | — | — | — | |
| BlindGPTTraining Mode=Supervised2024.02 | 51.6 | — | — | — | — | |
| VGTTraining Mode=Supervised2024.02 | 51.3 | — | — | — | — | |
| HQGATraining Mode=Supervised2024.02 | 47.7 | — | — | — | — | |
| CogAgentVision Encoder=CLIP-E, LLM Size=7B, Inference Vision=single, Inference LLM=single, Video Trained=false2024.03 | 43.7 | — | — | — | — | |
| BlindGPT2023.11 | — | 52.16 | 61.28 | 43.43 | 51.55 | |
| CaVIR2023.11 | — | 58.4 | 65.46 | 50.48 | 57.64 | |
| HGA2023.11 | — | 44.88 | 50.97 | 39.62 | 44.61 | |
| HQGA2023.11 | — | 48.24 | 54.32 | 41.71 | 47.66 | |
| Vamos2023.11 | — | 75.14 | 77.44 | 69.58 | 74.16 | |
| VGT2023.11 | — | 51.44 | 55.99 | 47.62 | 51.27 |