Video Question Answering on VSIBench
45.4AccuracyGemini-1.5-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-1.5-Pro#Frames=1fps2026.02 | 45.4 | |
| Weaver#Frames=128+1fps2026.02 | 40.3 | |
| Qwen2.5-VL#Frames=1282026.02 | 38.6 | |
| Weaver-SFT#Frames=128+1fps2026.02 | 38 | |
| Video-R1#Frames=642026.02 | 37.1 | |
| VideoRFT#Frames=322026.02 | 36.8 | |
| GPT4-o#Frames=1fps2026.02 | 34 | |
| LLaVA-OneVision#Frames=322026.02 | 32.4 |