Video Description on DREAM-1K Overall 1.0 (test)
40.1F1 ScoreTarsier2-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Tarsier2-7BModel=Tarsier2-7B2024.06 | 40.1 | 41.5 | 38.8 | |
| GPT-4oModel=GPT-4o2024.06 | 39.2 | 43.4 | 35.7 | |
| Tarsier-34BModel=Tarsier-34B2024.06 | 36.3 | 41.4 | 32.4 | |
| Gemini 1.5 ProModel=Gemini 1.5 Pro2024.06 | 36.2 | 37.6 | 34.8 | |
| Tarsier-7BModel=Tarsier-7B2024.06 | 34.6 | 40.3 | 30.2 | |
| GPT-4VModel=GPT-4V2024.06 | 34.4 | 40.8 | 29.7 | |
| PLLAVA-34BModel=PLLAVA-34B2024.06 | 28.2 | 38.4 | 22.3 | |
| VideoChat2Model=VideoChat2-Mistral2024.06 | 26.6 | 31 | 23.3 | |
| LLaVA-NeXT-VideoModel=LLaVA-NeXT-Video-34B-DPO2024.06 | 26.1 | 35.7 | 20.5 | |
| MiniGPT-4V+Model=MiniGPT-4V-Mistral2024.06 | 24 | 26.1 | 22.2 | |
| Video-LLaVAModel=Video-LLaVA2024.06 | 20.4 | 28.1 | 16 |