Video Description on DREAM-1K Live-action 1.0 (test)
43.8F1 ScoreTarsier2-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Tarsier2-7BModel=Tarsier2-7B2024.06 | 43.8 | 43.1 | 44.5 | |
| GPT-4oModel=GPT-4o2024.06 | 39.8 | 42.1 | 37.8 | |
| Tarsier-34BModel=Tarsier-34B2024.06 | 38.5 | 39.6 | 37.5 | |
| Tarsier-7BModel=Tarsier-7B2024.06 | 36.6 | 38.5 | 34.8 | |
| Gemini 1.5 ProModel=Gemini 1.5 Pro2024.06 | 36.4 | 36.4 | 36.4 | |
| GPT-4VModel=GPT-4V2024.06 | 34.8 | 39.2 | 31.3 | |
| PLLAVA-34BModel=PLLAVA-34B2024.06 | 29.3 | 34.9 | 25.2 | |
| VideoChat2Model=VideoChat2-Mistral2024.06 | 26 | 28.1 | 24.3 | |
| LLaVA-NeXT-VideoModel=LLaVA-NeXT-Video-34B-DPO2024.06 | 25.8 | 33.4 | 21 | |
| MiniGPT-4V+Model=MiniGPT-4V-Mistral2024.06 | 23.6 | 23.8 | 23.4 | |
| Video-LLaVAModel=Video-LLaVA2024.06 | 19.4 | 24.3 | 16.2 |