Video Detailed Description (VDD)
4VDD ScoreGPT-4V
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-4V2024.07 | 4 | 4.09 | 3.88 | 4.37 | 3.94 | 4.02 | |
| LLaVA-NeXT-Video-DPOSize=34B2024.07 | 3.6 | 3.84 | 3.81 | 3.55 | 4.24 | 3.14 | |
| LLaVA-NeXT-Video-DPOSize=7B2024.07 | 3.5 | 3.72 | 3.64 | 3.45 | 4.17 | 2.95 | |
| Video-LLaVASize=7B2024.07 | 3.3 | 2.87 | 2.94 | 3.44 | 2.45 | 2.51 | |
| VISTA-LLAMASize=7B2024.07 | 3.3 | 2.44 | 2.31 | 2.64 | 3.18 | 2.26 | |
| VideoChat2Size=7B2024.07 | 3.3 | 3.02 | 2.88 | 3.51 | 2.66 | 2.81 | |
| LLaMA-VIDSize=7B2024.07 | 3.3 | 2.84 | 3.01 | 2.97 | 3.54 | 2.53 | |
| LLaVA-NeXT-VideoSize=7B2024.07 | 3.2 | 3.32 | 3.39 | 3.29 | 3.92 | 2.6 | |
| LLaVA-NeXT-InterleaveSize=14B2024.07 | 3.19 | 3.59 | 3.65 | 3.37 | 3.98 | 3.67 | |
| LLaVA-NeXT-InterleaveSize=7B2024.07 | 3.13 | 3.57 | 3.51 | 3.28 | 3.89 | 3.68 | |
| LLaVA-NeXT-InterleaveSize=7B, Training Protocol=DPO2024.07 | 3.13 | 3.9 | 3.99 | 3.61 | 4.24 | 4.12 | |
| LLaVA-NeXT-InterleaveSize=0.5B2024.07 | 2.84 | 3.25 | 3.12 | 2.97 | 3.62 | 3.27 | |
| VideoChatGPTSize=7B2024.07 | 2.7 | 2.4 | 2.52 | 2.62 | 1.98 | 2.37 |