Video Question Answering on STAR zero-shot (test)
51.5Interaction ScoreIG-VLM-Llava13B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| IG-VLM-Llava13BNumber of Frames=6, Evaluation Protocol=Zero-shot2024.05 | 51.5 | 52 | 51 | 51.8 | 51.7 | |
| IG-VLM-Llava7BNumber of Frames=6, Evaluation Protocol=Zero-shot2024.05 | 49.3 | 50.1 | 48.4 | 48.8 | 49.6 | |
| SeViLANumber of Frames=32, Evaluation Protocol=Zero-shot2024.05 | 48.3 | 45 | 44.4 | 40.8 | 44.6 | |
| InternVideoNumber of Frames=8, Evaluation Protocol=Zero-shot2024.05 | 43.8 | 43.2 | 42.3 | 37.4 | 41.6 | |
| TOPA-Llama2-13BNumber of Frames=10, Evaluation Protocol=Zero-shot2024.05 | 41.6 | 46.2 | 44.2 | 36.7 | 43 | |
| TOPA-Llama3-8BNumber of Frames=10, Evaluation Protocol=Zero-shot2024.05 | 40.8 | 43.1 | 39.4 | 34.5 | 41.4 | |
| TOPA-Llama2-7BNumber of Frames=10, Evaluation Protocol=Zero-shot2024.05 | 36.4 | 45.6 | 39.3 | 36.3 | 41.3 |