Temporal Understanding on TempCompass and TVBench
0.738TempCompass ScoreGPT-4o
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4oBackbone=Proprietary2025.12 | 0.738 | 0.399 | 0.569 | |
| SEASONBackbone=QWEN2.5-VL-7B, Training-free=true2025.12 | 0.737 | 0.477 | 0.607 | |
| TCDBackbone=QWEN2.5-VL-7B, Training-free=true2025.12 | 0.734 | 0.461 | 0.598 | |
| DINO-HEALBackbone=QWEN2.5-VL-7B, Training-free=true2025.12 | 0.732 | 0.469 | 0.601 | |
| QWEN2.5-VL-7BBackbone=QWEN2.5-VL-7B2025.12 | 0.729 | 0.467 | 0.598 | |
| ArrowRLBackbone=QWEN2.5-VL-7B, Training-free=false2025.12 | 0.726 | 0.494 | 0.61 | |
| SEASONBackbone=LLaVA-Video-7B, Training-free=true2025.12 | 0.711 | 0.464 | 0.588 | |
| RRPOBackbone=LLaVA-Video-7B, Training-free=false2025.12 | 0.703 | 0.452 | 0.578 | |
| TCDBackbone=LLaVA-Video-7B, Training-free=true2025.12 | 0.7 | 0.452 | 0.576 | |
| DINO-HEALBackbone=LLaVA-Video-7B, Training-free=true2025.12 | 0.699 | 0.455 | 0.577 | |
| LLaVA-Video-7BBackbone=LLaVA-Video-7B2025.12 | 0.697 | 0.452 | 0.575 | |
| TPOBackbone=LLaVA-Video-7B, Training-free=false2025.12 | 0.695 | 0.451 | 0.573 | |
| SEASONBackbone=LLaVA-OV-7B, Training-free=true2025.12 | 0.693 | 0.43 | 0.561 | |
| TCDBackbone=LLaVA-OV-7B, Training-free=true2025.12 | 0.685 | 0.429 | 0.557 | |
| LLaVA-OV-7BBackbone=LLaVA-OV-7B2025.12 | 0.683 | 0.428 | 0.556 | |
| DINO-HEALBackbone=LLaVA-OV-7B, Training-free=true2025.12 | 0.683 | 0.429 | 0.556 | |
| Gemini 1.5 ProBackbone=Proprietary2025.12 | 0.671 | 0.476 | 0.574 |