Video Question Answering on MovieNet-QA 1.0 (test)
3.22Overview ScoreMovieLLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MovieLLMText=true, Vision=true, Tokens=18430, Latency=16.48 sec2024.05 | 3.22 | 3.38 | 2.18 | |
| LLaMA-VIDText=true, Vision=true, Tokens=18430, Latency=16.03 sec2024.05 | 3.09 | 3.31 | 2.02 | |
| VideoStreamingText=false, Vision=true, Tokens=256, Latency=5.32 sec2024.05 | 2.65 | 3.13 | 1.88 | |
| MovieLLMText=false, Vision=true, Tokens=5477, Latency=10.43 sec2024.05 | 2.36 | 2.97 | 1.58 | |
| LLaMA-VIDText=false, Vision=true, Tokens=5477, Latency=10.47 sec2024.05 | 2.28 | 2.88 | 1.46 |