Video Question Answering on Cinepile 2024 (test)
67.1AccuracyVideoDetective
Evaluation results
| Method | Links | |
|---|---|---|
| VideoDetectiveSize=7B, Evaluation Protocol=Training-included2025.12 | 67.1 | |
| Gemini-1.5-ProSize=-, Evaluation Protocol=Zero-shot2025.12 | 60.12 | |
| GPT-4oSize=-, Evaluation Protocol=Zero-shot2025.12 | 56.06 | |
| MiniCPM-V 2.6Size=8B, Evaluation Protocol=Zero-shot2025.12 | 46.91 | |
| LongVASize=7B, Evaluation Protocol=Zero-shot2025.12 | 41.04 | |
| mPLUG-Owl3Size=7B, Evaluation Protocol=Zero-shot2025.12 | 38.27 |