Video Question Answering on Vript RR
0.921Scene Accuracy (M)GPT-4O
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-4O2024.06 | 0.921 | 0.775 | 0.724 | 0.546 | |
| GPT-4OSampling rate=1 fps/100 fr2024.06 | 0.914 | 0.782 | 0.785 | 0.66 | |
| Gemini-1.5-Pro2024.06 | 0.851 | 0.685 | 0.599 | 0.475 | |
| GPT-4V2024.06 | 0.809 | 0.75 | 0.717 | 0.61 | |
| Claude 3.5-Sonnet2024.06 | 0.809 | 0.592 | 0.546 | 0.428 | |
| VILA-1.5Parameters=8B2024.06 | 0.75 | 0.487 | 0.553 | 0.323 | |
| Claude 3-Opus2024.06 | 0.638 | 0.6052 | 0.605 | 0.434 | |
| PLLAVAParameters=7B2024.06 | 0.625 | 0.461 | 0.553 | 0.362 | |
| Claude 3-Sonnet2024.06 | 0.605 | 0.539 | 0.566 | 0.421 | |
| VideoChat22024.06 | 0.52 | 0.322 | 0.421 | 0.224 | |
| ST-LLM2024.06 | 0.434 | 0.349 | 0.336 | 0.263 | |
| Video-LLaMA2024.06 | 0.382 | 0.197 | 0.283 | 0.145 | |
| VideoChatGPT2024.06 | 0.342 | 0.289 | 0.296 | 0.178 | |
| VideoChat2024.06 | 0.336 | 0.23 | 0.224 | 0.151 |