Video Question Answering on Finding Dory full (val)
27.33Relaxed Accuracy (All Tasks)Uniform Sampling
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Uniform SamplingQA LLM=GPT-4o, Frame number=962026.03 | 27.33 | 30.9 | 31.4 | 6.5 | |
| Uniform SamplingQA LLM=Gemini-2.0-Flash, Frame number=962026.03 | 25.73 | 31.5 | 25 | 8.8 | |
| GenSQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 16.6 | 22.6 | 13.6 | 2.9 | |
| FocusGraphQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 15.5 | 20.7 | 14.2 | 1.8 | |
| ViaRLQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 14.9 | 20.8 | 12.3 | 1.7 | |
| MaxInfoQA LLM=Qwen-2.5-VL-7B, Frame number=162026.03 | 13.7 | 17.5 | 13.4 | 1.9 | |
| Uniform SamplingQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 12.6 | 16.4 | 11.8 | 2 |