Video Question Answering on ECVA
92.22AccuracySRVAU-R1
Evaluation results
| Method | Links | |
|---|---|---|
| SRVAU-R1Thinking Setting=w/ think2026.02 | 92.22 | |
| SRVAU-R1Thinking Setting=w/o think2026.02 | 90.18 | |
| InternVL2.5-8B-MPOThinking Setting=w/o think2026.02 | 90 | |
| VAU-R1Thinking Setting=w/o think2026.02 | 89.53 | |
| Qwen2.5-VL-7BThinking Setting=w/ think2026.02 | 86.98 | |
| Qwen2-VL-2BThinking Setting=w/o think2026.02 | 86.98 | |
| VAU-R1Thinking Setting=w/ think2026.02 | 86.51 | |
| Qwen2.5-VL-3BThinking Setting=w/o think2026.02 | 85.58 | |
| Qwen2-VL-2BThinking Setting=w/ think2026.02 | 83.95 | |
| InternVL2.5-8B-MPOThinking Setting=w/ think2026.02 | 83.72 | |
| Qwen2.5-VL-7BThinking Setting=w/o think2026.02 | 83.02 | |
| InternVL2.5-2BThinking Setting=w/o think2026.02 | 78.84 | |
| Qwen2.5-VL-3BThinking Setting=w/ think2026.02 | 75.81 | |
| InternVL2.5-2BThinking Setting=w/ think2026.02 | 58.84 |