Video Description on DREAM-1K Stock 1.0 (test)
44F1 ScoreGPT-4o
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4oModel=GPT-4o2024.06 | 44 | 46.6 | 41.7 | |
| Tarsier2-7BModel=Tarsier2-7B2024.06 | 43.9 | 44.2 | 43.6 | |
| Gemini 1.5 ProModel=Gemini 1.5 Pro2024.06 | 42.2 | 40.7 | 43.8 | |
| Tarsier-34BModel=Tarsier-34B2024.06 | 41.7 | 46.4 | 37.8 | |
| GPT-4VModel=GPT-4V2024.06 | 40.7 | 46.7 | 36.1 | |
| Tarsier-7BModel=Tarsier-7B2024.06 | 39.6 | 44.7 | 35.5 | |
| PLLAVA-34BModel=PLLAVA-34B2024.06 | 35.1 | 42.5 | 29.9 | |
| VideoChat2Model=VideoChat2-Mistral2024.06 | 33.2 | 33.6 | 32.7 | |
| LLaVA-NeXT-VideoModel=LLaVA-NeXT-Video-34B-DPO2024.06 | 31.1 | 37.3 | 26.7 | |
| MiniGPT-4V+Model=MiniGPT-4V-Mistral2024.06 | 30.7 | 30.3 | 31.1 | |
| Video-LLaVAModel=Video-LLaVA2024.06 | 27 | 33.5 | 22.7 |