Open-ended Video Question Answering on NExT-QA (test)
33.9AccuracyFrameOracle
Evaluation results
| Method | Links | |
|---|---|---|
| FrameOracleBackbone=LLaVA-Video-7B, Frames=64→13.92025.10 | 33.9 | |
| FrameOracleBackbone=Qwen3-VL-8B, Frames=128→27.82025.10 | 33.8 | |
| FrameOracleBackbone=VideoLLaMA3-7B, Frames=64→13.92025.10 | 33.6 | |
| FrameOracleBackbone=LLaVA-Video-7B, Frames=16→10.42025.10 | 33 | |
| FrameOracleBackbone=VideoLLaMA3-7B, Frames=16→10.42025.10 | 32.9 | |
| LLaVA-Video-7BFrames=162025.10 | 32.4 | |
| VideoLLaMA3-7BFrames=162025.10 | 32.3 | |
| FrameOracleBackbone=Qwen3-VL-8B, Frames=32→20.92025.10 | 32.3 | |
| FrameOracleBackbone=Qwen2.5-VL-3B, Frames=128→27.82025.10 | 31.7 | |
| Qwen3-VL-8BFrames=322025.10 | 31.1 | |
| FrameOracleBackbone=Qwen2.5-VL-3B, Frames=32→20.92025.10 | 30.5 | |
| Qwen2.5-VL-3BFrames=322025.10 | 29.6 | |
| FrameOracleBackbone=LLaVA-OneVision-7B, Frames=64→13.92025.10 | 19 | |
| FrameOracleBackbone=LLaVA-OneVision-7B, Frames=16→10.42025.10 | 17.8 | |
| LLaVA-OneVision-7BFrames=162025.10 | 16.7 |