Video Question Answering on STAR v1.0 (test)
73.7Interaction AccuracyLRR*
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LRR*frames=not reported, additional surrogate tasks=true2024.11 | 73.7 | 71 | 71.3 | 65.1 | 70.3 | |
| IPRMframes=32, parallel operations (Nop)=6, reasoning steps (T)=92024.11 | 71.8 | 77.7 | 71 | 59.1 | 69.9 | |
| Concat-Att-4Lframes=322024.11 | 68.1 | 71.4 | 66.6 | 55.2 | 65.3 | |
| Cross-Att-4Lframes=322024.11 | 67.5 | 72.1 | 64.4 | 58.5 | 65.6 | |
| SeViLA-BLIP2frames=322024.11 | 63.7 | 70.4 | 63.1 | 62.4 | 64.9 | |
| InternVideoframes=82024.11 | 62.7 | 65.6 | 54.9 | 51.9 | 58.7 | |
| MISTframes=322024.11 | 55.5 | 54.2 | 54.2 | 44.4 | 51.1 | |
| LRR (w/o surrogate)frames=32, additional surrogate tasks=false2024.11 | 54.5 | 48.7 | 44.3 | 45.5 | 48.2 | |
| Temp[ATP]frames=322024.11 | 50.6 | 52.8 | 49.3 | 40.6 | 48.3 | |
| All-in-Oneframes=322024.11 | 47.5 | 50.8 | 47.7 | 44 | 47.5 |