Video Description on DREAM-1K (300 randomly sampled videos)
0.717Tarsier Wins RateTarsier-34B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Tarsier-34BComparison Baseline=PLLaVA-34B2024.06 | 0.717 | 0.08 | 0.203 | 0.514 | |
| Tarsier-34BComparison Baseline=GPT-4V2024.06 | 0.5 | 0.123 | 0.377 | 0.123 | |
| Tarsier-34BComparison Baseline=Gemini 1.5 Pro2024.06 | 0.28 | 0.373 | 0.347 | -0.067 | |
| Tarsier2-7BComparison Baseline=GPT-4o2024.06 | 0.232 | 0.584 | 0.184 | 0.048 |