Video Description on DREAM-1K Animation 1.0 (test)
37.1F1Tarsier2-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Tarsier2-7BModel=Tarsier2-7B2024.06 | 37.1 | 37.2 | 37.1 | |
| GPT-4oModel=GPT-4o2024.06 | 35.8 | 39.1 | 33.1 | |
| Tarsier-34BModel=Tarsier-34B2024.06 | 32.2 | 35.8 | 29.2 | |
| Gemini 1.5 ProModel=Gemini 1.5 Pro2024.06 | 30.7 | 31.8 | 29.7 | |
| Tarsier-7BModel=Tarsier-7B2024.06 | 29.3 | 34.6 | 25.5 | |
| GPT-4VModel=GPT-4V2024.06 | 27.4 | 31.9 | 24 | |
| LLaVA-NeXT-VideoModel=LLaVA-NeXT-Video-34B-DPO2024.06 | 22 | 32 | 16.7 | |
| PLLAVA-34BModel=PLLAVA-34B2024.06 | 20.9 | 32 | 15.6 | |
| VideoChat2Model=VideoChat2-Mistral2024.06 | 18.8 | 23.9 | 15.5 | |
| MiniGPT-4V+Model=MiniGPT-4V-Mistral2024.06 | 16.4 | 19 | 14.5 | |
| Video-LLaVAModel=Video-LLaVA2024.06 | 15.3 | 21.2 | 11.9 |