Video Question Answering on Finding Dory (dev)
27.5Overall Relaxed AccuracyFocusGraph
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FocusGraphQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 27.5 | 34.5 | 28.3 | 3.1 | |
| Uniform SamplingQA LLM=GPT-5-Mini, Frame number=82026.03 | 26.82 | 28.36 | 38.99 | 2.8 | |
| ReMEmbRQA LLM=GPT-5.2, Frame number=512026.03 | 26.56 | 31.1 | 32.3 | 2.8 | |
| Uniform SamplingQA LLM=Gemini-3-Flash, Frame number=82026.03 | 26.42 | 31.82 | 30.6 | 2.1 | |
| GenSQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 22.3 | 25.5 | 28.1 | 2.8 | |
| ViaRLQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 21.4 | 28 | 30 | 1.2 | |
| ReMEmbRQA LLM=Llama3.1-8B, Frame number=72026.03 | 21.16 | 27.2 | 19.4 | 4.1 | |
| Uniform SamplingQA LLM=Qwen-2.5-VL-7B, Frame number=82026.03 | 18.4 | 22.6 | 19.4 | 3.2 | |
| MaxInfoQA LLM=Qwen-2.5-VL-7B, Frame number=162026.03 | 17.2 | 19.5 | 22.2 | 2.1 |