Video Description on DREAM-1K Shorts 1.0 (test)
40.9F1 ScoreTarsier2-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Tarsier2-7BModel=Tarsier2-7B2024.06 | 40.9 | 45.5 | 37.1 | |
| GPT-4oModel=GPT-4o2024.06 | 39.9 | 47.9 | 34.2 | |
| Gemini 1.5 ProModel=Gemini 1.5 Pro2024.06 | 37 | 42.4 | 32.7 | |
| GPT-4VModel=GPT-4V2024.06 | 34.8 | 46.1 | 28 | |
| Tarsier-34BModel=Tarsier-34B2024.06 | 34 | 44.1 | 27.7 | |
| Tarsier-7BModel=Tarsier-7B2024.06 | 33.6 | 44.6 | 26.9 | |
| VideoChat2Model=VideoChat2-Mistral2024.06 | 26.5 | 36.8 | 20.7 | |
| PLLAVA-34BModel=PLLAVA-34B2024.06 | 25.6 | 41.9 | 18.4 | |
| LLaVA-NeXT-VideoModel=LLaVA-NeXT-Video-34B-DPO2024.06 | 24.2 | 39.8 | 17.4 | |
| MiniGPT-4V+Model=MiniGPT-4V-Mistral2024.06 | 23.7 | 29.1 | 20 | |
| Video-LLaVAModel=Video-LLaVA2024.06 | 18.5 | 29.4 | 13.5 |