Video Question Answering on CGBench mini
36.7p@1GPT-5.2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5.2frames=642026.07 | 36.7 | 44.3 | 37.2 | |
| Qwen3-VL-4B-Instructparameters=4B2026.07 | 34.7 | 43.5 | 34.7 | |
| Qwen3-VL-8B-Instructparameters=8B2026.07 | 34.7 | 43.5 | 34.7 | |
| VSeek-GPTbase_model=GPT-5.22026.07 | 34.4 | 56.2 | 39.9 | |
| VSeek-EMreward_type=exact-match2026.07 | 33.2 | 52.3 | 34.5 | |
| VSeek-VETLreward_type=VETL2026.07 | 32.3 | 51.1 | 33.3 | |
| Qwen3-VL-4B-Thinkingparameters=4B2026.07 | 31.6 | 41.6 | 32.4 | |
| Qwen3-VL-8B-Thinkingparameters=8B2026.07 | 31.3 | 49.9 | 33.7 | |
| Naive RAG2026.07 | 30.4 | 41.2 | 32.2 | |
| VideoTree2026.07 | 29.6 | 31.9 | 30 | |
| InternVL-3.5-4Bparameters=4B2026.07 | 21.5 | 49.2 | 22.3 |