Narrative Reasoning on MSR-VTT (test)
3.67Accuracy ScoreLogicAgent
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LogicAgentNumber of Parameters=1.7B, Model Type=Proposed Method2026.02 | 3.67 | 4.33 | 3.58 | 3.42 | 3.75 | 3.67 | |
| NS-DRModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.61 | 4.15 | 3.54 | 3.35 | 3.7 | 3.45 | |
| CENModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.59 | 4.16 | 3.65 | 3.37 | 3.98 | 2.74 | |
| NSVS-TLModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.58 | 4.25 | 3.56 | 3.38 | 3.72 | 3.53 | |
| GITModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.57 | 4.11 | 3.51 | 3.28 | 3.89 | 2.77 | |
| GPT-4oModel Type=Proprietary LVLM2026.02 | 3.53 | 4.2 | 3.42 | 3.29 | 3.58 | 3.42 | |
| AKGNNModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.47 | 4.09 | 3.48 | 3.29 | 3.63 | 3.4 | |
| Gemini 1.5 ProModel Type=Proprietary LVLM2026.02 | 3.41 | 4.24 | 3.27 | 3.13 | 3.76 | 3.14 | |
| Vid2SeqModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.33 | 4.12 | 3.58 | 3.13 | 3.67 | 3.5 | |
| ShareGPT4VideoModel Type=Open-Source LVLM2026.02 | 3.31 | 4.09 | 3.33 | 3.18 | 3.52 | 3.31 | |
| SEM-POSModel Type=Video Reasoning & Neuro-Symbolic Methods2026.02 | 3.25 | 3.97 | 3.12 | 2.97 | 3.62 | 3.26 | |
| Qwen3-VL-8BModel Type=Open-Source LVLM, Number of Parameters=8B2026.02 | 3.1 | 3.85 | 3.35 | 2.8 | 3.45 | 3.35 | |
| Qwen2.5-VL-7BModel Type=Open-Source LVLM, Number of Parameters=7B2026.02 | 2.94 | 4 | 3.24 | 2.65 | 3.66 | 3.17 | |
| VideoLLaVAModel Type=Open-Source LVLM2026.02 | 2.52 | 3.88 | 3.24 | 2.65 | 3.02 | 3.5 |