Video Description on DREAM-1K YouTube 1.0 (test)
34.5F1 ScoreTarsier-34B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Tarsier-34BModel=Tarsier-34B2024.06 | 34.5 | 41.1 | 29.7 | |
| Tarsier2-7BModel=Tarsier2-7B2024.06 | 34.5 | 37.7 | 31.8 | |
| Gemini 1.5 ProModel=Gemini 1.5 Pro2024.06 | 34 | 36.7 | 31.6 | |
| GPT-4VModel=GPT-4V2024.06 | 33.8 | 40.1 | 29.2 | |
| GPT-4oModel=GPT-4o2024.06 | 33.8 | 40.1 | 29.2 | |
| Tarsier-7BModel=Tarsier-7B2024.06 | 33 | 39.2 | 28.4 | |
| PLLAVA-34BModel=PLLAVA-34B2024.06 | 28.9 | 40.8 | 22.3 | |
| VideoChat2Model=VideoChat2-Mistral2024.06 | 27.3 | 32.7 | 23.4 | |
| LLaVA-NeXT-VideoModel=LLaVA-NeXT-Video-34B-DPO2024.06 | 26.5 | 36.2 | 20.9 | |
| MiniGPT-4V+Model=MiniGPT-4V-Mistral2024.06 | 24.8 | 28.4 | 22.1 | |
| Video-LLaVAModel=Video-LLaVA2024.06 | 21.2 | 31.9 | 15.8 |