Video Question Answering on Active Memory Benchmark
44.7Q1VideoMindPalace
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VideoMindPalace2025.01 | 44.7 | — | 27.9 | 24.2 | 34.5 | — | 42.7 | 46.4 | — | 41 | 57.4 | 37.8 | |
| VideoAgent2025.01 | 35.6 | — | 26.1 | 23.3 | 34.2 | — | 38.2 | 39.2 | — | 38.2 | 43.5 | 34.6 | |
| AMEGO2025.01 | 33.7 | — | 36.3 | 37.2 | 38.3 | — | 27.6 | 44.3 | — | 34.7 | 48.9 | 36.3 | |
| S-QA2025.01 | 23.9 | — | 22 | 22.5 | 23.3 | — | 27.5 | 27 | — | 20.2 | 24.1 | 23.6 | |
| LLoVi2025.01 | 22.3 | — | 21.4 | 21.8 | 22.2 | — | 25.6 | 26.7 | — | 18.1 | 22.2 | 22.4 | |
| Random2025.01 | 20 | — | 20 | 20 | 20 | — | 20 | 20 | — | 20 | 20 | 20 | |
| VideoTree2025.01 | 17.5 | — | 25.3 | 25 | 32.7 | — | 34.3 | 42.5 | — | 15.4 | 22.9 | 27 | |
| IG-VLM2025.01 | 17.3 | — | 23 | 21.4 | 31.6 | — | 33.1 | 38.4 | — | 18.3 | 19.6 | 25.3 |