Video Question Answering on VideoEspresso 1.0
51.9Narrative AccuracyGPT-4o + ReViSe
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4o + ReViSe#Frames=7.99, Param=-2026.02 | 51.9 | 46.5 | 55.1 | 44 | 54.1 | 53.2 | 48.6 | 50.8 | 40.3 | 49.1 | 50.8 | 58.5 | 53.3 | 58 | 48.9 | |
| VideoEspresso#Frames=2.36, Param=8.5B2026.02 | 45.2 | 27 | 33.7 | 26.1 | 39.3 | 36.7 | 55.6 | 41.3 | 30.6 | 29.8 | 30.8 | 35.8 | 20 | 26 | 34.1 | |
| Qwen2-VL + ReViSe#Frames=6.25, Param=7B2026.02 | 39.2 | 39.5 | 38.1 | 33.3 | 50.8 | 46.7 | 40.3 | 50 | 25.8 | 28.1 | 43.1 | 33.3 | 36.7 | 38.8 | 37.8 | |
| LongVA-DPO#Frames=128, Param=7B2026.02 | 35.5 | 14.9 | 16.3 | 19 | 34.4 | 22 | 37.5 | 23.8 | 29 | 22.8 | 20 | 37.7 | 16.7 | 12 | 24.4 | |
| InternVL2 + ReViSe#Frames=2.87, Param=8B2026.02 | 35.5 | 29.6 | 36 | 21.3 | 39.3 | 33 | 36.1 | 31.7 | 18.3 | 24.6 | 36.9 | 40.9 | 42.9 | 23.4 | 32.1 | |
| InternVL2#Frames=FPS=1, Param=8B2026.02 | 33.9 | 24.1 | 27.6 | 24.4 | 42.6 | 33 | 45.8 | 28.6 | 19.4 | 22.8 | 21.5 | 34 | 20 | 24 | 28.7 | |
| Qwen-VL-Max#Frames=FPS=3, Param=-2026.02 | 33.9 | 22.4 | 23.5 | 21.4 | 26.2 | 30.3 | 41.7 | 30.2 | 27.4 | 26.3 | 20 | 20.8 | 16.7 | 24 | 26 | |
| LLaVA-1.5#Frames=4, Param=7B2026.02 | 32.3 | 21.3 | 19.4 | 17.1 | 26.2 | 20.2 | 36.1 | 33.3 | 21 | 21.1 | 20 | 35.8 | 16.7 | 18 | 24.2 | |
| GPT-4o#Frames=FPS=3, Param=-2026.02 | 32.3 | 16.7 | 25.5 | 22.8 | 32.8 | 27.5 | 37.5 | 28.6 | 24.2 | 19.3 | 30.8 | 30.2 | 20 | 22 | 26.4 | |
| LLaVA-N-Video#Frames=FPS=1, Param=7B2026.02 | 31.2 | 20.2 | 16.2 | 17.6 | 36.5 | 32.7 | 30.6 | 24.5 | 26.4 | 24.5 | 34.7 | 20.8 | 20.3 | 17 | 25.2 | |
| mPLUG-Owl3#Frames=FPS=1, Param=7B2026.02 | 30.6 | 23.6 | 20.4 | 22.3 | 37.7 | 29.4 | 48.6 | 34.9 | 30.6 | 24.6 | 27.7 | 24.5 | 13.3 | 24 | 28 | |
| Qwen2-VL#Frames=FPS=1, Param=7B2026.02 | 27.4 | 23 | 24.5 | 23.5 | 29.5 | 31.2 | 47.2 | 31.7 | 22.6 | 28.1 | 40 | 22.6 | 30 | 18 | 28.5 | |
| LLaVA-N-Inter#Frames=FPS=1, Param=7B2026.02 | 24.2 | 23.6 | 26.5 | 19.2 | 31.1 | 32.1 | 31.9 | 17.5 | 24.2 | 21.1 | 26.2 | 30.2 | 13.3 | 20 | 24.4 |