Video Question Answering on DualityVidQA (test)
97AC Real AccuracyDNA-Train
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DNA-TrainParameters=7B2025.12 | 97 | 72.7 | 72.7 | 94.3 | 74.1 | 69 | 94.6 | 83.3 | 79.2 | 98.4 | 82.9 | 81.3 | 95.8 | 80.1 | 76.8 | |
| GPT-4o2025.12 | 87.9 | 75.8 | 63.6 | 93.7 | 74.7 | 69.6 | 91 | 68.3 | 61.1 | 94.7 | 73.8 | 68.4 | 92.7 | 72.1 | 65.8 | |
| Qwen2.5-VLParameters=7B2025.12 | 87.9 | 60.6 | 48.5 | 88 | 57 | 46.2 | 93.7 | 53.8 | 49.3 | 93 | 69.5 | 63.1 | 91.7 | 59.9 | 52.8 | |
| Qwen2.5-VLParameters=32B2025.12 | 87.9 | 54.5 | 45.5 | 94.3 | 68.4 | 63.3 | 95.5 | 43 | 39.4 | 96.8 | 59.4 | 56.1 | 95.2 | 55.4 | 51.3 | |
| GPT-4o-mini2025.12 | 84.8 | 51.5 | 36.4 | 89.9 | 58.2 | 50 | 91.4 | 53.4 | 48.9 | 95.2 | 62.6 | 59.9 | 91.8 | 57.4 | 51.9 | |
| GPT-4.12025.12 | 84.8 | 84.8 | 69.7 | 89.2 | 81.6 | 73.4 | 86.4 | 68.8 | 59.7 | 87.2 | 76.5 | 65.2 | 87.3 | 75.5 | 65.6 | |
| Gemini-2.5 Pro2025.12 | 84.8 | 81.8 | 69.7 | 91.8 | 88 | 80.4 | 92.8 | 78.3 | 73.3 | 94.1 | 75.9 | 71.1 | 92.5 | 80.3 | 74.3 | |
| Qwen2.5-VLParameters=72B2025.12 | 84.8 | 60.6 | 45.5 | 93.7 | 71.5 | 65.2 | 96.8 | 52.9 | 50.7 | 98.4 | 67.4 | 65.8 | 95.8 | 62.8 | 58.9 | |
| Gemini-2.5 Flash2025.12 | 75.8 | 72.7 | 54.5 | 88.6 | 74.1 | 67.7 | 89.1 | 62 | 55.2 | 92 | 66.8 | 59.4 | 89.1 | 67.3 | 59.8 | |
| LLaVA-Next-Video2025.12 | 57.6 | 33.3 | 9.1 | 67.1 | 29.7 | 13.9 | 69.2 | 31.7 | 16.3 | 71.1 | 42.8 | 21.4 | 68.6 | 34.7 | 16.9 | |
| Video-LLaVAParameters=7B2025.12 | 54.5 | 39.4 | 15.2 | 56.3 | 42.4 | 17.1 | 71.5 | 33.5 | 16.3 | 58.3 | 51.3 | 20.3 | 62.4 | 41.7 | 17.7 | |
| Random2025.12 | 27.3 | 27.3 | 9.1 | 25.3 | 20.3 | 5.1 | 19 | 22.2 | 2.3 | 28.9 | 28.3 | 5.9 | 24.2 | 23.9 | 4.5 | |
| VideoChat2-HD2025.12 | 21.2 | 27.3 | 3 | 27.2 | 27.2 | 1.3 | 20.8 | 26.7 | 0 | 29.9 | 27.8 | 0.5 | 25.4 | 27.2 | 0.7 |