Video Description on Toyota Smarthome ADL-VD
91.5CorEE4D-VideoLLaMA3
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| EE4D-VideoLLaMA3Method Category=Vision Language Models2025.01 | 91.5 | 92.5 | 95.8 | 79 | 73.5 | 86.4 | |
| Ego2ExoVLMMethod Category=Vision Language Models2025.01 | 90.8 | 93.1 | 95.9 | 80.8 | 82.9 | 88.7 | |
| VideoLLaMA3Method Category=Vision Language Models2025.01 | 88.1 | 91.8 | 92.6 | 79.2 | 84.4 | 87.2 | |
| LLAVIDALMethod Category=Vision Language Models2025.01 | 66 | 86.2 | 79.6 | 50 | 72.4 | 70.8 | |
| ADL-X-ChatGPTMethod Category=Vision Language Models2025.01 | 62.4 | 79.4 | 70.8 | 51.2 | 60.4 | 64.8 | |
| VideoLLaMAMethod Category=Vision Language Models2025.01 | 57.8 | 62 | 62.4 | 48.2 | 44.4 | 54.9 | |
| Chat-UniViMethod Category=Vision Language Models2025.01 | 56.8 | 66.9 | 79 | 50 | 56.6 | 61.9 | |
| CogVLM + GPTMethod Category=Image captioners + LLM2025.01 | 55.2 | 72 | 60.6 | 30.2 | 48.5 | 53.3 | |
| CogVLM + LlamaMethod Category=Image captioners + LLM2025.01 | 49.8 | 66 | 56.6 | 29.8 | 40.2 | 48.5 | |
| BLIP2 + GPTMethod Category=Image captioners + LLM2025.01 | 48.8 | 66.6 | 63.6 | 45.6 | 39.8 | 52.9 | |
| VideoChatGPTMethod Category=Vision Language Models2025.01 | 31.2 | 52.8 | 78.2 | 64.8 | 45.6 | 54.5 | |
| VideoLLaVAMethod Category=Vision Language Models2025.01 | 30.8 | 54.8 | 42.4 | 30.4 | 44.5 | 40.6 |