Open-ended Video Question Answering on NExTQA (val)
28.9AccuracyFrameOracle
Evaluation Results
| Method | Links | |
|---|---|---|
| FrameOracleBackbone=VideoLLaMA3-7B, Frames=64→13.92025.10 | 28.9 | |
| FrameOracleBackbone=LLaVA-Video-7B, Frames=64→13.92025.10 | 28.8 | |
| FrameOracleBackbone=VideoLLaMA3-7B, Frames=16→10.42025.10 | 28.3 | |
| FrameOracleBackbone=Qwen3-VL-8B, Frames=128→27.82025.10 | 28.1 | |
| FrameOracleBackbone=LLaVA-Video-7B, Frames=16→10.42025.10 | 27.8 | |
| VideoLLaMA3-7BFrames=162025.10 | 27.8 | |
| LLaVA-Video-7BFrames=162025.10 | 27.3 | |
| FrameOracleBackbone=Qwen3-VL-8B, Frames=32→20.92025.10 | 26.6 | |
| FrameOracleBackbone=Qwen2.5-VL-3B, Frames=128→27.82025.10 | 26 | |
| Qwen3-VL-8BFrames=322025.10 | 26 | |
| FrameOracleBackbone=Qwen2.5-VL-3B, Frames=32→20.92025.10 | 25.6 | |
| Qwen2.5-VL-3BFrames=322025.10 | 25.1 | |
| FrameOracleBackbone=LLaVA-OneVision-7B, Frames=64→13.92025.10 | 16.5 | |
| FrameOracleBackbone=LLaVA-OneVision-7B, Frames=16→10.42025.10 | 16.1 | |
| LLaVA-OneVision-7BFrames=162025.10 | 14.6 |